Summary
Overview
Work History
Education
Skills
Timeline
Generic
Prakash Kaliannan

Prakash Kaliannan

Data Engineer
Chennai

Summary

  • Results-driven Software Engineer with 13+ years of experience in Data engineering, ML engineering, Cloud-based solutions and Cross Platform mobile development.
  • Integrated FAISS (Facebook AI Similarity Search) to identify similar records from historical customer data, improving deduplication and recommendation accuracy.
  • Deployed an AI-driven loan eligibility prediction system using Python and PySpark on Azure Databricks clusters, enabling scalable model training and real-time predictions.
  • Skilled in building scalable data pipelines, real-time ingestion frameworks using Azure AD, Apache Kafka, Airflow, Camel, and CDC workflows using Debezium.
  • Developed REST APIs using Python with Django, FastAPI and Airflow to build Customer Data Platforms (CDPs), enabling actionable insights and driving business growth.
  • Secondary expertise in cross-platform mobile development (Flutter, Android/Java, Dart) and backend engineering with Python.

Overview

14
14
years of professional experience

Work History

Lead Data & Mobile Engineer

Origa Technologies
12.2022 - Current
  • AI-Powered Loan Eligibility Prediction - Designed and deployed an AI-driven loan eligibility prediction system using Python and PySpark on Azure Databricks clusters. Built a data pipeline with Azure Data Factory (ADF) Copy Activity to ingest training and testing data from multiple sources, and processed it within Databricks compute for model training and evaluation. The system estimates ticket size (loan amount) based on features such as customer segment, tenure, number of assets, applicant’s age, turnover, net profit, credit criteria, and PAT. Implemented quantile-based outlier detection and removal on performance variables, and performed correlation analysis (R² > 0.25) for feature selection. Trained the model using Generalized Linear Models (GLM) and integrated it with real-time customer data, enabling sales teams to instantly provide accurate, personalized loan amount estimates. Additionally, integrated FAISS (Facebook AI Similarity Search) to identify similar records from historical customer data. FAISS leverages nearest-neighbour search algorithms to efficiently retrieve the closest or most comparable past cases, enhancing prediction accuracy and enabling better decision support for loan assessments.
  • Azure-Based Scalable Data Pipelines & Content Moderation -Leveraged Microsoft Azure to build scalable data pipelines for Summanati Fintech, utilizing Azure Data Factory, Azure Linking Services, and cloud-based data sources. Additionally, implemented text and image moderation by integrating Azure Cognitive Services APIs to generate predictive scores for content validation and compliance.
  • Real-Time CDC Pipeline & CRM Integration - Implemented a real-time Change Data Capture (CDC) pipeline using Debezium to stream updates from a PostgreSQL RDS instance. Built modular microservices to consume Kafka topics and integrate changes with Zoho CRM via Zoho APIs. Deployed and orchestrated these microservices on Kubernetes to ensure scalability, fault tolerance, and seamless rollout of updates.
  • Real-Time WhatsApp Chatbot Data Pipeline - Designed and developed a robust data pipeline to capture customer interactions from WhatsApp chatbot conversations and route them in real time to the call center team. Leveraged Apache Airflow to orchestrate the workflow and integrated the processed data into a customer-centric CRM, enabling immediate visibility into customer needs and proactive engagement by the support team.
  • E-Commerce Customer Activity Pipeline - Built a data pipeline using Apache Airflow to capture customer activity from the e-commerce website and route actionable insights to the respective sales or support teams. This streamlined workflow enabled timely engagement and improved lead conversion rates.
  • Hybrid Mobile App for Field Operations - End-to-end app development and developed a hybrid mobile application using Flutter for field agents to capture customer requirements and monitor daily activities via GPS tracking (Google Location Services). The app supports both online and offline modes, with automatic data sync to the server when connectivity is restored. Deployed on both Google Play Store and Apple App Store, it also integrates Firebase Cloud Messaging (FCM) to enable real-time push notifications for updates and task assignments.
  • Flutter-Based Industrial Service Request App - Built a hybrid mobile application using the Flutter framework to manage industrial machine service requests. The app enables customers to easily initiate service requests, which are automatically assigned to field engineers for resolution—streamlining the entire service workflow and enhancing response efficiency. Enable PhonePe payment gateway for secure payment. The application is published on both the Google Play Store and Apple App Store.
  • Python Django Campaign Management Platform - Built a campaign management platform using the Python Django framework to support both email and WhatsApp outreach. Integrated Facebook Meta APIs for WhatsApp messaging and Amazon SES and SNS for email delivery. Implemented event tracking for message sent, viewed, read, and clicked activities using a webhook callback mechanism, enabling real-time engagement analytics.
  • WhatsApp Chatbot for E-Commerce with Payments - Built a WhatsApp chatbot using the Python Django framework and WhatsApp Business API for an e-commerce platform, enabling users to browse products, initiate purchases, request services, and contact support directly via WhatsApp. Integrated WhatsApp Catalog for seamless product navigation and connected the PhonePe payment gateway for secure, in-chat transactions.

Senior Software Engineer – Mobile & Data

Scisphere Analytics
12.2013 - 11.2022
  • Digital Transformation for Crop Lifecycle Management - Led the digital transformation of crop lifecycle management for a leading agrochemical client (AVT) by implementing muBPM a lightweight mobile-based Micro Business Process Management solution to streamline and automate field operations directly on handheld devices.
  • Predictive Model for Branch Expansion - Designed and developed an analytics model to predict potential regions for new branch expansion based on key business indicators. Initially prototyped the model in Python using Pandas, NumPy, Scikit-learn, and Matplotlib for data processing and visualization. The solution was later migrated to R and deployed on a DeployR server for enhanced statistical modeling. To scale and operationalize the model within our product Scisphere, we re-engineered it using Scala and Apache Spark, leveraging Spark MLlib for distributed model scoring and real-time branch expansion insights.
  • Regional Analytics for Customer-Centric Insights - Worked with over 300 customer-centric metrics and processed 100+ derived data points scraped from government sources. Utilized Python, Pandas, NumPy, and Scikit-learn to clean, manipulate, and transform the data into a standardized format. This structured dataset enabled the development of regional analytics models to identify trends and support strategic decision-making across various regions in India.
  • Financial Data Pipeline & Analytics - Established a robust data pipeline to ingest and consolidate financial data such as portfolio performance, collections, demand, collection efficiency, and PAR (Portfolio at Risk) metrics from multiple customer sources. Utilized Apache Camel for data integration and Apache Airflow for workflow orchestration to power interactive dashboards and financial analytics.


Software Engineer – Mobile & Backend

Ohile Technologies
05.2011 - 12.2013
  • Symbian Mobile Apps for RedBus & CCD - Developed a mobile application for RedBus and Café Coffee Day (CCD) using the Symbian platform for Nokia devices, aimed at expanding their customer reach and supporting business growth during the early mobile adoption phase.
  • Integrated Mobile & Web Apps with SOAP Web Services - Integrated mobile and web applications with SOAP-based web services, enabling seamless communication with legacy backend systems. Implemented XML parsing, request/response handling, and error management to ensure reliable data exchange and system interoperability.

Education

Bachelor of Engineering - Information Technology

Mepco Schlenk Engineering College
Sivakasi, India
04-2011

Skills

  • Data Engineering: Azure ADF, Apache Kafka, Apache Airflow, Apache Camel, ETL Pipelines
  • Big Data & Analytics: PySpark, Scala, Hadoop, Pandas, NumPy, Scikit-learn
  • Cloud & DevOps: Azure with Delta Lake Medallion Architecture, AWS – (LMR, Lamda, S3, SMS, SNS), Docker, Google Firebase
  • Backend & APIs: Python, Java, Django REST Framework, Fast API, GraphQL, REST APIs
  • Databases: PostgreSQL, SQL, MySQL, MongoDB
  • Marketing Automation: Email/WhatsApp Campaigns (AWS SES/SNS, FB Meta APIs)
  • Mobile Development: Android (Java, Dart), Flutter, Google Play Store, Apple App Store
  • CDP & CRM Integration: Audience Segmentation, ETL, Zoho CRM

Timeline

Lead Data & Mobile Engineer

Origa Technologies
12.2022 - Current

Senior Software Engineer – Mobile & Data

Scisphere Analytics
12.2013 - 11.2022

Software Engineer – Mobile & Backend

Ohile Technologies
05.2011 - 12.2013

Bachelor of Engineering - Information Technology

Mepco Schlenk Engineering College
Prakash KaliannanData Engineer