Suresh Palanisamy
Data Engineer
Erode
Summary
Experienced Data Engineer with 5 years of expertise in designing, developing, and optimizing scalable data pipelines using Apache Airflow, Snowflake, Databricks, AWS, and Python. Skilled in building robust ETL/ELT workflows, integrating data from diverse sources, and delivering high-quality datasets for analytics and business intelligence. Proficient in Python-based API and backend application development, cloud data warehousing, and workflow automation. Strong experience in monitoring, troubleshooting, and optimizing data pipelines to improve reliability, performance, and operational efficiency. Passionate about leveraging modern data engineering practices to build scalable, data-driven solutions that enable informed business decisions and operational excellence.
Overview
5
5
years of professional experience
5
5
years of post-secondary education
1
1
Certification
Work History
Data Engineer | Backend Developer
SBNA Software Solutions Pvt Ltd
11.2021 - Current
- SBNA is a fast-growing futuristic Information Technology Service Provider.
- Designed and executed ETL processes using Apache Airflow to extract data from source systems, transform it into a usable format, and load it into data warehouses.
- Administered and optimized databases, ensuring data integrity, security, and performance
- Monitored data pipelines, identified issues, and troubleshooter problems to ensure continuous data availability.
- Developed RESTful APIs for ETL applications to maintain and monitor all ETL processes.
Backend Developer
SBNA Software Solutions Pvt Ltd
7 2021 - 10.2021
- In cases of issues with water plants, like water waste, the user inputs details into the application.
- Designed and implemented a water management web application to identify problems and provide solutions to users.
Education
XII - Mathematics Biology
SSV Hr Sec School Kodumudi
Erode, TN 06.2013 - 05.2014
Bachelor of Science - Computer Science
University College of Engineering
Villupuram, India 05.2014 - 05.2018
Skills
Python, Flask, SQL, NoSQL
AWS
MySQL, Snowflake, PostgreSQL, Dynamodb, Redshift
GitHub, JIRA, VS Code, GitLab, Agile Development
Airflow, Pandas, Numpy, SQLAlchemy, JavaScript Basic, Docker, Databricks
Certification
AWS Certified Developer - Associate, 12/2022, 12/2025
Projects
Project1: ChaliceAi: (Python, Airflow, Snowflake, AWS) | 11/2021-Present:
Role - Data Engineer and Backend Developer,
- Developed and maintained scalable ETL pipelines using Apache Airflow, extracting data from AWS S3, GCP, and client databases, transforming it, and loading it into Snowflake.
- Standardized and optimized data structures for multiple clients, ensuring consistency and improved query performance.
- Designed and built a web-based ETL monitoring dashboard using Python, Flask. enabling real-time visibility and management of data pipelines
Project2: DecisionTree (Python, PostgreSQL, AWS) | 07/2021-10/2021:
Role - Backend Developer,
- Developed a water management web application to help users identify and resolve issues related to water waste in treatment plants.
- Engineered a PostgreSQL-backed data model to store and analyze user inputs, improving problem identification accuracy.
- Implemented RESTful APIs to process user data and provide real-time recommendations for water conservation
Timeline
Data Engineer | Backend Developer
SBNA Software Solutions Pvt Ltd
11.2021 - Current
Bachelor of Science - Computer Science
University College of Engineering
05.2014 - 05.2018
XII - Mathematics Biology
SSV Hr Sec School Kodumudi
06.2013 - 05.2014
Backend Developer
SBNA Software Solutions Pvt Ltd
7 2021 - 10.2021