NIRMAL KUMAR S

Flixmedia, UK (Current Project - Datinfi Pvt Ltd)

• Infrastructure Setup & Monitoring: Architected and deployed cloud infrastructure on Google Cloud Platform (GCP), configuring VMs, networking, and storage. Set up real-time monitoring and logging with Stackdriver, Prometheus, and Grafana.
• Production Deployment & Release Management: Managed application deployments, ensuring smooth rollouts with minimal downtime. Coordinated release schedules and version control, following best practices to minimize risks.
• GCP Infrastructure Engineering: Designed scalable and cost-effective infrastructure using Compute Engine, Cloud Storage, and BigQuery, ensuring reliability and efficiency.
• Security & Access Control: Configured firewall rules and implemented robust security measures including IAM, encryption, and regular audits. Managed security patches to protect against vulnerabilities.

Wersel App Project

• Cloud Infrastructure Management: Maintain and administer Hetzner Cloud services, ensuring optimal performance and availability for Wersel applications.
• Kubernetes & Big Data Setup: Set up and maintain multi-node Kubernetes, Dremio, Elasticsearch, and Kafka clusters on Hetzner dedicated servers for scalable application deployments.
• CI/CD Automation: Implement automated CI/CD pipelines for seamless deployment of multiple Python services and React UI components, improving efficiency and reducing deployment time.
• Monitoring & Observability: Set up Prometheus and Grafana for real-time monitoring and alerting on cluster performance, ensuring system health and proactive issue resolution.
• Access Management: Administer server and database user access, enforcing security protocols and managing permissions across the infrastructure.
• Big Data Administration: Install, configure, and monitor tools such as HDFS, YARN, SQOOP, PIG, HIVE, FLUME, Oozie, HBASE, and KAFKA for big data processing and analytics.
• Data Visualization: Deploy and maintain Superset and Zeppelin for advanced data visualization and reporting, enhancing data-driven decision-making within the organization.

Projects: The Sole SupplierUK (Datinfi Pvt Ltd)

• Improved code deployment efficiency through CI/CD automation.
• Streamlined collaboration using Git version control systems.
• Designed and implemented a MongoDB multinode setup.
• Set up Jenkins pipelines for continuous integration and delivery.
• Monitored build processes to ensure rapid resolution of build/release failures.
• Developed Python code setup and integrated logs into Elasticsearch.
• Monitored logs using Kibana dashboards for real-time insights and analysis.

• IoT Sensors Data Analysis (Ongoing):Analyzing real-time sensor data from an IoT framework stored in MongoDB for predictive insights and system optimization.
  Designed and implemented data pipelines, integrating MongoDB with HBase for real-time and near-real-time data synchronization.
  Utilized Zeppelin to visualize data from Hive, providing detailed analysis and reporting on sensor performance and trends.
  
• Website Log Analysis:Developed a solution to extract meaningful insights from large volumes of website log data using MapReduce, Java, Sqoop, and Hive.
  Built and optimized data pipelines, importing data from MySQL to HDFS using Sqoop and transforming it for analysis using Hive.
  Processed and cleansed static log data, performing advanced queries using HiveQL to generate reports on user behavior and system performance.