About me (Registered since 25/01/2026)

Senior Data Engineer with over 8 years of experience designing, building, and supporting scalable data platforms on Microsoft Azure. Specialized in developing batch and streaming data pipelines using Azure Data Factory, Azure Databricks (PySpark, Spark SQL, Delta Lake), and Azure Synapse Analytics. Strong experience integrating data from Azure SQL databases, REST APIs, Kafka, JSON, and XML, and enabling analytics and reporting through Synapse and Power BI. Proven expertise in performance optimization, CI/CD pipelines, data validation, and production support across SIT, UAT, and live environments. Experienced in Agile/Scrum delivery, collaborating closely with business, analytics, and infrastructure teams to deliver reliable, high-quality data solutions.

Skills

Tech Skills

Education

  • June 2013 - May 2017
    SSN COLLEGE OF ENGINEERING

    Bachelor's Degree in Electronics and Communication Engineering

    India

    Bachelor’s Degree in Electronics and Communication Engineering with a strong foundation in programming, databases, and system design, supporting a career in data engineering and analytics.

  • June 2011 - May 2013
    Sri Jayendra Saraswathi Silver Jubilee School

    Higher Secondary Certificate

    India

    Completed Higher Secondary education with a strong focus on mathematics, physics, and computer fundamentals, developing analytical thinking and problem-solving skills that support a career in engineering and data analytics.

  • June 2010 - May 2011
    Sri Jayendra Saraswathi Silver Jubilee School

    Secondary School Certificate (SSC)

    India

    Completed Secondary School education with a solid academic foundation, emphasizing logical reasoning, mathematics, and core science subjects.

Key Skills and Competencies

Technical Skills: Azure Databricks (PySpark, Spark SQL, Delta Lake, Databricks Jobs/Workflows), Azure Data Factory (ADF), Azure Synapse Analytics, ADLS Gen2, Apache Spark, Kafka, REST APIs, JSON, XML, Azure SQL Database, SQL Server, Advanced SQL (window functions, performance tuning), CI/CD pipelines (GitHub Actions, Azure DevOps), Power BI, SSRS. Functional Skills: Data pipeline design and orchestration, batch and streaming data processing, data transformation and aggregation, data validation and profiling, data governance, performance optimization, monitoring and alerting, SIT/UAT and production support, analytics and reporting enablement. Leadership & Collaboration Skills: Requirement analysis and grooming, Agile/Scrum collaboration, cross-functional teamwork with analytics and infrastructure teams, problem-solving, incident management, documentation, and continuous improvement.

Work Experience

  • August 2023 - Present
    Credit Agricole Corporate Investment Bank, Singapore

    Data Engineer

    • Designed and maintained batch and streaming data pipelines using Azure Databricks (PySpark, Spark SQL, Delta Lake) for large-scale data processing.

    • Orchestrated end-to-end ingestion and transformation workflows using Azure Data Factory (ADF), loading curated data into ADLS Gen2 and exposing it through Azure Synapse Analytics and Power BI.

    • Integrated data from Azure SQL databases, REST APIs, Kafka, JSON, and XML, ensuring data quality, reliability, and consistency.

    • Implemented and managed Databricks Jobs / Workflows with scheduling, monitoring, retries, and automated error handling.

    • Optimized Spark and SQL performance through partitioning, caching, and query tuning to improve pipeline efficiency.

    • Implemented CI/CD pipelines using GitHub Actions / Azure DevOps and supported SIT, UAT, and production deployments in Agile/Scrum environments.

  • April 2021 - August 2023
    Tata Consultancy Services, India

    BI Developer / Data Analyst

    • Designed and implemented Azure-based data pipelines using Azure Data Factory (ADF), ADLS, and Azure SQL Database to support automated ingestion and reporting.

    • Developed and orchestrated ADF pipelines with scheduling, monitoring, and error handling for reliable batch processing.

    • Created Power BI dashboards and Paginated Reports to deliver operational and analytical insights to business users.

    • Built Azure Functions (C#) for REST API integration, OAuth authentication, JSON processing, and database ingestion.

    • Implemented workflow automation using Power Automate for alerts, notifications, and business-triggered actions.

    • Optimized SQL queries, stored procedures, and data models to improve performance and reporting efficiency.

  • June 2017 - April 2021
    Accenture, India

    BI Developer / Data Analyst

    • Delivered end-to-end MSBI solutions using SSIS, SSRS, and SSAS (Tabular & Multidimensional) to support enterprise reporting and analytics.

    • Designed Power BI dashboards with DAX measures, KPIs, drill-down/drill-through, and Row-Level Security (RLS).

    • Integrated external data sources (REST APIs, JSON, XML, flat files) using C# and VB.NET utilities into SQL Server.

    • Designed relational and dimensional models (Star/Snowflake) to enable scalable analytical workloads.

    • Optimized SQL Server performance through indexing, stored procedures, and data validation logic.

    • Automated job scheduling and dependencies using Control-M, ensuring reliable daily, weekly, and month-end executions.

Languages

English
Advance
Tamil
Advance

Certifications & Licences

  • Jan 2024 - Jan 2025

    Microsoft Certified Data Analyst

    Validated expertise in data modeling, DAX, Power BI reporting, data visualization, and delivering business insights using Microsoft analytics tools.

  • 2021, 2025, 2026

    Programming in Python

    Demonstrated proficiency in C# programming, object-oriented principles, and building data integration and application components. Covered Python fundamentals, data structures, and scripting concepts applied to data processing and automation tasks.

  • 2020

    Querying Data with Transact-SQL (Microsoft)

    Validated skills in writing advanced SQL queries, joins, subqueries, window functions, and performance-oriented data retrieval.

  • 2017

    Programming in C# (Microsoft)

    Demonstrated proficiency in C# programming, object-oriented principles, and building data integration and application components.