Summary
Overview
Work History
Education
Skills
Accomplishments
Timeline
Generic

THIRUMALAI GOMATHI AVUDAIYAPPAN

Chennai

Summary

Experienced Data Engineer with a proven track record of designing, building, and maintaining scalable and efficient data pipelines using various technologies such as Spark, SQL, Scala,AWS services and visualizations using Tableau . Possesses strong analytical and problem-solving skills with a focus on data quality, security, and optimization.

Overview

10
10
years of professional experience

Work History

Lead Data Engineer

TATA CONSULTANCY SERVICES
08.2023 - 02.2025
  • Managed a 5 member team and handled 20 + applications.
  • Contributed to open-source projects in the field of big-data ecosystem strengthening my understanding of emerging platforms while giving back to the community at large.
  • Streamlined data ingestion processes to accommodate increasing volumes of incoming information while maintaining data integrity and ensuring timely accessibility across the organization.
  • Identified areas for improvement within existing ETL frameworks to maximize efficiency without sacrificing accuracy or integrity of results produced during transformations applied on ingested datasets.
  • Enhanced data quality and reliability for real-time analytics by designing and deploying robust data pipelines.
  • Utilized data visualization tools to effectively communicate business insights.

Data Engineer

TATA CONSULTANCY SERVICES
02.2022 - 08.2023
  • Designed 10+ scalable and maintainable data models to support business intelligence initiatives and reporting needs.
  • Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
  • Streamlined complex workflows by breaking them down into manageable components for easier implementation and maintenance.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.

ETL Developer

TATA CONSULTANCY SERVICES
06.2015 - 01.2022

Worked as a part of the below major projects,

  • Matters Requiring Attention(MRA) Sales :As a full stack developer , Implemented scenarios and load standardization tables using Pyspark and HQL
  • Airtool Agile Project: As a Pyspark developer , worked in conversion of SAS code logic into Pyspark code, automation of code and schedule through autosys as monthly run.
  • GFE Comprehensive Database Solutions: As a full stack developer, Performed transformations and load target tables and sent error reports to users , Implemented Slowly Changing Dimension 2 graph to maintain history data.
  • CPP Proof of Concept Fraud HLA: As a Ab Initio developer, set up shared drive to receive source files, validating input files and loading detail and summary tables.

Education

Bachelor of Engineering - Computer Science

Government College Of Erode
04.2015

Skills

  • Abinitio
  • SQL
  • PySpark
  • Scala
  • Tableau
  • Big Data - Hive,Spark
  • Data modelling
  • AWS services
  • Data Pipeline Design
  • Airflow
  • DBT
  • Control center
  • Autosys

Accomplishments

  • 8+ years of experience in banking domain (Citi)
  • 15 + months of experience in Airline domain (Singapore airlines)
  • Handled multiple ETL tools/ strategies together along with Visualization tools and supporting technologies.
  • 10 + TCS internal awards for the continuous learning and supporting various projects.

Timeline

Lead Data Engineer

TATA CONSULTANCY SERVICES
08.2023 - 02.2025

Data Engineer

TATA CONSULTANCY SERVICES
02.2022 - 08.2023

ETL Developer

TATA CONSULTANCY SERVICES
06.2015 - 01.2022

Bachelor of Engineering - Computer Science

Government College Of Erode
THIRUMALAI GOMATHI AVUDAIYAPPAN