Summary
Overview
Work History
Education
Skills
Technical Summary
Timeline
Generic

Rajesh Chinnadurai

Data Enginner
Tamilnadu

Summary

Experienced Data Engineer with 6 years specializing in Big Data development and cloud-based data engineering (GCP). Dedicated to creating scalable, efficient, and reliable data solutions to drive business success. Skilled in designing and developing ETL pipelines for structured and unstructured data using IBM Datastage, Informatica, and Python/Shell scripts. Proficient in GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and workflow orchestration tools like Airflow (Astronomer) and Autosys. Strong in BigQuery SQL, Python, and Shell scripting for data transformation, automation, and troubleshooting to ensure SLA adherence and data quality. Experienced in debugging batch pipelines, performance tuning, and deploying Qlik and Alteryx for data migration projects to cloud-based data warehouses. Knowledgeable in CI/CD processes using GitHub for version control and automated deployments. Collaborative team player in Agile environments, delivering reliable data solutions aligned with business objectives. Skilled in production monitoring, incident management, and root cause analysis using tools like ServiceNow and GCP Logging.

Overview

6
6
years of professional experience
2015
2015
years of post-secondary education

Work History

Senior Data Engineer

HTC Global Services (India) Pvt Ltd
05.2025 - Current
  • The project involves managing and supporting a large-scale enterprise data platform for a global automotive client. It focuses on ensuring the reliability, accuracy, and availability of critical data pipelines that serve business reporting, analytics, and operational insights.
  • As part of the data engineering team, I am responsible for monitoring end-to-end data workflows, identifying and resolving failures in Airflow DAGs and Autosys jobs, performing incident triaging and root cause analysis, and maintaining seamless data delivery across cloud-based infrastructure.
  • The platform is built on Google Cloud Platform (GCP), leveraging services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage for batch and real-time processing.
  • I also manage the deployment and scheduling of Alteryx workflows and Qlik dashboards, enabling business teams to access timely and refreshed data. My work contributes directly to data quality assurance, performance tuning, and supporting CI/CD processes using tools like GitHub and ServiceNow for operational excellence.

Senior Engineer

Apexon India Pvt Ltd-Chennai
11.2021 - 05.2025
  • Worked in the GDIA Command Center team, managing end-to-end pipeline monitoring, failure handling, and support for all CDM sub-products.
  • Identified and resolved Airflow DAG (Astronomer) failures, ensuring timely data delivery and SLA adherence.
  • GCP Operations & Monitoring: Managing and troubleshooting Apache Airflow DAGs (Cloud Composer) to ensure seamless execution of data pipelines, along with proactive monitoring and issue resolution.
  • Managed and supported data workflows and batch processes across 22+ sub-products under the Customer Data Mart (CDM) ecosystem, including Connected Vehicle, Ford Direct & Dealer, FCSD, and Sales & Incentives.
  • Supported and optimized batch job executions using Autosys and provided proactive monitoring.
  • Used BigQuery SQL (BQSQL) to run data validation and quality checks in support of ad-hoc reporting.
  • Managed incident triaging and root cause analysis using ServiceNow and GCP Logging.
  • Collaborated with dev teams to deploy enhancements, fine-tune performance, and ensure stability.
  • Deployed and maintained Alteryx Designer workflows, including job publishing, scheduling, and triggering.
  • Handled deployment and scheduling of Qlik dashboards, including refresh and update cycles.
  • Involved in dataset design and access control setup in BigQuery, including partitioning and authorized views.
  • Gained exposure to ETL development and debugging in Datastage, Informatica, and Teradata.
  • Followed best practices in CI/CD pipelines using GitHub for deployment and version control.
  • Maintained runbooks, flowcharts, and documentation for all major processes and issue resolution steps.
  • Acted as a key liaison between business users and technology teams, ensuring timely communication and issue handling.

Data Engineer

Sahas Business Solutions Pvt Ltd
04.2019 - 06.2021

Education

Bachelor of Technology (B.Tech) - Electronics and Communication Engineering

Periyar Maniammai University
Thanjavur
05.2015

Skills

    Unix

undefined

Technical Summary

Unix, Windows, Oracle SQL, Hive, Unix, Python, Shell Scripting, GitLab, Bitbucket, Jenkins, GitHub, Oracle, Teradata SQL, DataStage, Putty, PostgreSQL, MySQL, Hadoop, Spark, Hive, SQOOP, AWS (S3, Lambda, EC2, RDS), GCP (Big Query, Cloud Storage), Autosys, Airflow, Control-M, Informatica, DataStage

Timeline

Senior Data Engineer

HTC Global Services (India) Pvt Ltd
05.2025 - Current

Senior Engineer

Apexon India Pvt Ltd-Chennai
11.2021 - 05.2025

Data Engineer

Sahas Business Solutions Pvt Ltd
04.2019 - 06.2021

Bachelor of Technology (B.Tech) - Electronics and Communication Engineering

Periyar Maniammai University

Similar Profiles

CREATE PROFILE
Rajesh ChinnaduraiData Enginner