Summary
Overview
Work History
Education
Skills
Accomplishments
Certification
Timeline
Generic

Prasanth B

Senior Data Engineer
Coimbatore

Summary

◆ Senior Data Engineer with 5+ years of experience delivering scalable, high-quality data solutions across cloud data platforms.

◆ Proven expertise in end-to-end data warehouse modernization, including large-scale migration from Redshift to Snowflake, successfully transitioning 500+ tables in a short span with high data quality and reliability.

◆ Strong foundation in ELT development using dbt, building robust data models with complex business logic, reusable macros, UDFs, and comprehensive testing frameworks.

◆ Extensive experience in designing and implementing modern data architectures (Medallion – Bronze, Silver, Gold layers) to enable structured, analytics-ready data ecosystems.

◆ Skilled in handling complex and semi-structured data (JSON) using Python-based frameworks with integrated validation and testing mechanisms.

◆ Hands-on expertise in data ingestion and integration using tools like Fivetran and Salesforce, ensuring consistent and reliable data pipelines.

◆ Deep understanding of data governance and security, including column-level security, data classification, lineage tracking, and usage monitoring using Atlan.

◆ Experienced in workflow orchestration and monitoring using Airflow and Splunk, ensuring high pipeline reliability and observability.

◆ Strong background in AWS data ecosystem (S3, Glue, Redshift, EMR) with prior experience in building scalable Spark-based ETL pipelines for large datasets.

◆ Demonstrated ability in ETL testing, QA validation, and performance optimization, ensuring data accuracy, completeness, and integrity across systems.

◆ Recognized for attention to detail, high-quality delivery standards, and disciplined engineering practices in building production-grade data solutions.

◆ Effective collaborator with cross-functional teams, consistently delivering data solutions aligned with business requirements and timelines.

Overview

5
5
years of professional experience
3
3
Certifications
4
4
Languages

Work History

Senior Data Engineer

Cloud Destinations
04.2023 - Current

◆ Led a large-scale migration from AWS Redshift to Snowflake, successfully transitioning over 500 tables with high data quality and end-to-end ownership.
◆ Designed and developed robust ELT pipelines using dbt, implementing complex business logic, reusable macros, UDFs, and data quality tests.
◆ Built and optimized data pipelines, integrating multiple sources such as Fivetran and Salesforce into the data warehouse.
◆ Developed custom Python-based frameworks for handling complex and semi-structured (JSON) data, with validation mechanisms.
◆ Contributed to the implementation of the Medallion Architecture (Bronze, Silver, Gold layers) for scalable and analytics-ready data models.
◆ Ensured strong data governance practices using Atlan, including lineage tracking, classification, and column-level security.

◆ Orchestrated and monitored workflows using Airflow; implemented observability using Splunk.
◆ Collaborated with cross-functional teams to deliver high-quality data solutions within defined timelines.
◆ Provided quick resolution for AWS data warehouse-related issues, and ensured platform stability.
◆ Demonstrated strong expertise in finance data handling, with secure and compliant data practices.

◆ Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.

◆ Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.

◆ Championed the adoption of agile methodologies within the team, resulting in faster delivery times and increased collaboration among team members.

◆ Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.

Junior Data Engineer

Wavicle Data Solutions
05.2021 - 03.2023

◆ Built and maintained highly scalable data pipelines using AWS and Apache Spark for processing large datasets.
Designed and implemented ETL pipelines using AWS Glue to transform raw JSON data into Parquet across Medallion layers.
◆ Developed dimension models with Slowly Changing Dimensions (SCD) for efficient analytical querying in Redshift.
◆ Processed large-scale datasets using PySpark on AWS EMR/EC2 with optimized transformations and performance tuning.
◆ Strong understanding of Spark architecture including joins optimization, partitioning, bucketing, caching, and memory tuning.
◆ Performed end-to-end ETL testing, including data validation, regression testing, and performance benchmarking.
◆ Managed large datasets using advanced SQL (CTEs, temp tables) and multiple file formats (CSV, JSON).
◆ Configured monitoring and alerting for AWS Glue jobs using CloudWatch.
◆ Contributed to CI/CD pipelines using Jenkins and version control using Git.
◆ Conducted code reviews, troubleshooting, and ensured high-quality, reliable data pipelines.
◆ Created documentation and supported teams with best practices and technical guidance.

◆ Developed custom scripts for automating repetitive tasks, freeing up valuable time for team members to focus on more strategic initiatives.

Education

Bachelor of Engineering -

Government College of Technology
Coimbatore
04.2001 -

Skills

  • ◆ Languages: Python, PySpark, Scala, SQL, C
    ◆ Cloud & Storage: AWS (S3, EC2, Athena, Glue, Redshift, EMR), Azure (Databricks, Synapse, Data Lake), Snowflake
    ◆ Data Processing: Apache Spark, pandas
    ◆ Data Warehousing: Snowflake, Redshift, Synapse
    ◆ Data Transformation: dbt, dbt Cloud
    ◆ Orchestration: Airflow
    ◆ Data Integration: Fivetran, Salesforce
    ◆ Governance: Atlan
    ◆ ETL Tools: AWS Glue, Databricks
    ◆ CI/CD & Version Control: GitHub Actions, Jenkins, Git (GitHub, GitLab, Bitbucket)
    ◆ Monitoring: Splunk, AWS CloudWatch
    ◆ Visualization: Matplotlib, Seaborn
    ◆ IDEs: Jupyter, PyCharm, VS Code

Accomplishments

    ◆ Led large-scale data platform migration from Redshift to Snowflake, achieving ~30% cost reduction and zero data compromise with improved scalability.

    ◆ Built production-grade dbt pipelines with advanced transformations, modular architecture, and testing frameworks, improving data reliability by ~40% and reducing pipeline failures.

    ◆ Implemented modern Medallion Architecture (Bronze, Silver, Gold), enhancing data accessibility and query performance by ~35%.

    ◆ Delivered high-performance data pipelines integrating multiple enterprise sources, reducing data processing time by ~40% and optimizing resource utilization.

    ◆ Automated complex semi-structured (JSON) data processing frameworks, improving pipeline efficiency by ~30% and reducing manual effort.

Certification

SnowPro Associate: Platform Certification

Timeline

SnowPro Associate: Platform Certification

03-2026

Dbt Fundamentals

05-2024

Databricks Certified Associate Developer for Apache Spark 3.0 - Python

12-2023

Senior Data Engineer

Cloud Destinations
04.2023 - Current

Junior Data Engineer

Wavicle Data Solutions
05.2021 - 03.2023

Bachelor of Engineering -

Government College of Technology
04.2001 -
Prasanth BSenior Data Engineer