Selvaraj A
Consultant Data Engineer
Chennai
Summary
Solutions focused, Meticulous and result-oriented Google Certified Data Engineer offering around 8 years of successful career in Big Data arena.
Overview
8
8
years of professional experience
5
5
Certifications
Work History
Consultant Data Engineer
Accenture Solutions
Chennai
08.2021 - Current
- Orchestrated the migration of a large-scale data warehouse to GCP, resulting in a 30% reduction in operational costs and a 20% improvement in data processing speed.
- Have worked on supplychain product development and hands on experience on GCP in all bigdata products Bigquery, Cloud Data Proc, Google Cloud Storage and Composer.
- Optimized SQL queries on BigQuery, resulting in a 40% decrease in query execution time and a significant improvement in the performance of data-intensive applications.
- Managed the extraction, transformation, and loading (ETL) processes using Talend and Bigquery, reducing data processing time by 30%
- Built and architect multiple Data pipelines , end to end ETL and ELT process for Data ingestion and transformation in GCP and coordinate task among the team.
- Collaborated with Product owners and Business analysts to develop Bigquery models , leading to a 10% increase in the accuracy of the data.
- Worked in code review processes to ensure Google best practices are followed.
- Managing a team of junior data engineers, providing mentorship and guidance on GCP best practices, leading to a 15% increase in team productivity.
Big Data Developer
Comcast India Engineering Center
Chennai
10.2018 - 08.2021
- Involved in analysis of requirements and business rules based on given documentation and work closely with tech leads and Business analysts in understanding the current system
- Developed real-time pipelines to provide insights for debugging system integrations, improving operating efficiency by 20%.
- Worked on several functions in Python Library to build Spark Applications, Spark SQL, RDDs -Transformations, Actions, data frames and pushed the results to the HDFS.
- Developed Hive programs to parse the raw data, populate staging tables and to store the redefined data in partitioned tables in the EDW.
- Communicated with Business departments to understand needs and requests in order to build pipelines for analyzing metrics.
Associate , Data Services
Amazon India (Alexa)
Chennai
04.2016 - 09.2018
- Develop Spark Applications to process the whole log data uploaded by Alexa device.
- Develop and Schedule Shell scripts to pre-process data and automate the manual work which increased the productivity of associate by 20%
- Analyzing the millions of log lines from devices to ensure the tuning and logging metrics are up to the mark.
- Built data processing pipeline and performed data cleaning, features scaling, features extraction using Pandas and Numpy.
- Built and published interactive reports and dashboard and worksheets for analytic purpose in Tableau.
- Enabled Hive support and performed Bucketing , sorting and combination of both in Spark and wrote them to Apache metastore.
- Designed data quality rules to ensure the efficiency and quantity of the data.
Education
Bachelor of Engineering, India - Electronics And Communication Engineering
SCAD College Of Engineering And Technology
Tirunelveli 04.2001 -
HSC - Computer Science
Seventh Day Higher Secondary School
Kochi 04.2001 -
SSLC -
Seventh Day Higher Secondary School
04.2001 -
Skills
BigQuery
GCS
Dataproc
Dataflow
DBT
Snowflake
Airflow
Python
SQL
Spark
SAP Hana
SAP Dataservices
Hive
AWS Redshift
Sqoop
Github Actions
Jenkins
Tableau
Languages
English
Bilingual or Proficient (C2)
Tamil
Bilingual or Proficient (C2)
Malayalam
Bilingual or Proficient (C2)
Certification
Google Certified Professional Data Engineer
Interests
Cricket
Badminton
Travel
Movies
Music
Software
Visual Studio Code
Intellij
Pycharm
Github
Azure Devops
Timeline
Consultant Data Engineer
Accenture Solutions
08.2021 - Current
Big Data Developer
Comcast India Engineering Center
10.2018 - 08.2021
Associate , Data Services
Amazon India (Alexa)
04.2016 - 09.2018
Bachelor of Engineering, India - Electronics And Communication Engineering
SCAD College Of Engineering And Technology
04.2001 -
HSC - Computer Science
Seventh Day Higher Secondary School
04.2001 -
SSLC -
Seventh Day Higher Secondary School
04.2001 -
Similar Profiles
SARITA SAHARANSARITA SAHARAN
Manager Talent Acquisition at Accenture SolutionsManager Talent Acquisition at Accenture Solutions
Kiran R VKiran R V
Payment & Reconciliation Analyst at Accenture SolutionsPayment & Reconciliation Analyst at Accenture Solutions
Harshavardhan T KHarshavardhan T K
Packaged App Development Analyst at Accenture SolutionsPackaged App Development Analyst at Accenture Solutions