About me (Registered since 25/01/2026)
Senior Data Engineer with over 8 years of experience designing, building, and supporting scalable data platforms on Microsoft Azure. Specialized in developing batch and streaming data pipelines using Azure Data Factory, Azure Databricks (PySpark, Spark SQL, Delta Lake), and Azure Synapse Analytics. Strong experience integrating data from Azure SQL databases, REST APIs, Kafka, JSON, and XML, and enabling analytics and reporting through Synapse and Power BI. Proven expertise in performance optimization, CI/CD pipelines, data validation, and production support across SIT, UAT, and live environments. Experienced in Agile/Scrum delivery, collaborating closely with business, analytics, and infrastructure teams to deliver reliable, high-quality data solutions.
Skills
Tech Skills
Education
-
June 2013 - May 2017
SSN COLLEGE OF ENGINEERING
Bachelor's Degree in Electronics and Communication Engineering
India
Bachelor’s Degree in Electronics and Communication Engineering with a strong foundation in programming, databases, and system design, supporting a career in data engineering and analytics.
-
June 2011 - May 2013
Sri Jayendra Saraswathi Silver Jubilee School
Higher Secondary Certificate
India
Completed Higher Secondary education with a strong focus on mathematics, physics, and computer fundamentals, developing analytical thinking and problem-solving skills that support a career in engineering and data analytics.
-
June 2010 - May 2011
Sri Jayendra Saraswathi Silver Jubilee School
Secondary School Certificate (SSC)
India
Completed Secondary School education with a solid academic foundation, emphasizing logical reasoning, mathematics, and core science subjects.
Work Experience
-
August 2023 - Present
Credit Agricole Corporate Investment Bank, Singapore
Data Engineer
-
Designed and maintained batch and streaming data pipelines using Azure Databricks (PySpark, Spark SQL, Delta Lake) for large-scale data processing.
-
Orchestrated end-to-end ingestion and transformation workflows using Azure Data Factory (ADF), loading curated data into ADLS Gen2 and exposing it through Azure Synapse Analytics and Power BI.
-
Integrated data from Azure SQL databases, REST APIs, Kafka, JSON, and XML, ensuring data quality, reliability, and consistency.
-
Implemented and managed Databricks Jobs / Workflows with scheduling, monitoring, retries, and automated error handling.
-
Optimized Spark and SQL performance through partitioning, caching, and query tuning to improve pipeline efficiency.
-
Implemented CI/CD pipelines using GitHub Actions / Azure DevOps and supported SIT, UAT, and production deployments in Agile/Scrum environments.
-
-
April 2021 - August 2023
Tata Consultancy Services, India
BI Developer / Data Analyst
-
Designed and implemented Azure-based data pipelines using Azure Data Factory (ADF), ADLS, and Azure SQL Database to support automated ingestion and reporting.
-
Developed and orchestrated ADF pipelines with scheduling, monitoring, and error handling for reliable batch processing.
-
Created Power BI dashboards and Paginated Reports to deliver operational and analytical insights to business users.
-
Built Azure Functions (C#) for REST API integration, OAuth authentication, JSON processing, and database ingestion.
-
Implemented workflow automation using Power Automate for alerts, notifications, and business-triggered actions.
-
Optimized SQL queries, stored procedures, and data models to improve performance and reporting efficiency.
-
-
June 2017 - April 2021
Accenture, India
BI Developer / Data Analyst
-
Delivered end-to-end MSBI solutions using SSIS, SSRS, and SSAS (Tabular & Multidimensional) to support enterprise reporting and analytics.
-
Designed Power BI dashboards with DAX measures, KPIs, drill-down/drill-through, and Row-Level Security (RLS).
-
Integrated external data sources (REST APIs, JSON, XML, flat files) using C# and VB.NET utilities into SQL Server.
-
Designed relational and dimensional models (Star/Snowflake) to enable scalable analytical workloads.
-
Optimized SQL Server performance through indexing, stored procedures, and data validation logic.
-
Automated job scheduling and dependencies using Control-M, ensuring reliable daily, weekly, and month-end executions.
-
Certifications & Licences
-
Jan 2024 - Jan 2025
Microsoft Certified Data Analyst
Validated expertise in data modeling, DAX, Power BI reporting, data visualization, and delivering business insights using Microsoft analytics tools.
-
2021, 2025, 2026
Programming in Python
Demonstrated proficiency in C# programming, object-oriented principles, and building data integration and application components. Covered Python fundamentals, data structures, and scripting concepts applied to data processing and automation tasks.
-
2020
Querying Data with Transact-SQL (Microsoft)
Validated skills in writing advanced SQL queries, joins, subqueries, window functions, and performance-oriented data retrieval.
-
2017
Programming in C# (Microsoft)
Demonstrated proficiency in C# programming, object-oriented principles, and building data integration and application components.