Experienced Data Engineer with expertise in Data Migration and Remediation, leveraging ADF, Databricks and Synapse Analytics. Proficient in designing Cloud Architectures, automating workflows with Control-M, and integrating AKV for secure data handling.
Overview
3
3
years of professional experience
Work History
Azure Data Engineer
Cognizant (Client: Voya Financial)
08.2024 - Current
Worked on ADF Remediation project involving Data Migration and the transition of Linked Services from SAS URI to User-Assigned Managed Identity with secrets managed via Azure Key Vault.
Updated 100+ pipelines to include external staging for data movement from Azure Blob to Snowflake, leveraging Lookup activities.
Actively collaborated in Azure DevOps through pull requests for pipeline updates and version Control.
Tech involved: ADF, SQL, Azure DevOps
Azure Data Engineer
Cognizant (Client: PepsiCo)
06.2022 - 08.2024
Led the Analysis, design, and architecture of a data migration project for PepsiCo.
Migrated data from Teradata and Oracle to Azure Synapse Analytics.
Implemented a 3-layer architecture (ACQ, DWL and APP) using S&T for data ingestion and Databricks with PySpark for data transformations, Quality checks, and staging.
Automated the end-to-end process, including job scheduling using Control-M, ensuring seemless data flow into Synapse Analytics.
Education
B.E - Electronics And Instrumentation Engineering
RMK Engineering College
Chennai, India
05-2021
Skills
Data migration
ETL development
SQL programming
Azure Data Factory
Azure Databricks
Azure KeyVault, Managed Identities
PySpark
Teradata
SQL Server Management Studio
Azure DevOps
Accomplishments
Star Performer of the Year 2023 - PepsiCo
Certified in Azure Data Fundamentals (AZ-900)
Completed Databricks certified associate Data Engineer Course.
Certification – Spark programming in Python
Timeline
Azure Data Engineer
Cognizant (Client: Voya Financial)
08.2024 - Current
Azure Data Engineer
Cognizant (Client: PepsiCo)
06.2022 - 08.2024
B.E - Electronics And Instrumentation Engineering
RMK Engineering College
Similar Profiles
Michael SmithMichael Smith
Vice President/Product Director at Voya Financial/ING/Aetna Financial ServicesVice President/Product Director at Voya Financial/ING/Aetna Financial Services