About me (Registered since 13/12/2025)
At Concentrix, contributed to designing and implementing CI/CD pipelines on Databricks using GitLab and dbt, enhancing deployment processes and development efficiency. Engineered end-to-end batch data pipelines utilizing PySpark, SQL, and Python to consolidate and process multi-source data. Migrated legacy data pipelines from Azure and Pentaho to GCP, leveraging Big Data technologies for improved scalability and performance.
Holds a Master of Engineering in Computer Science & Engineering from Chandigarh University and a Bachelor of Technology from Career Point University. Core competencies include Python, SQL, and Databricks, with additional expertise in cloud-based tools and Big Data frameworks. Passionate about building scalable, efficient data systems to enable insightful decision-making.
Skills
Tech Skills
Portfolio
Education
- July 2018 - June 2020
Work Experience
-
September 2022 - Present
Concentrix, India
Data Engineer
– Designed and implemented CI/CD pipelines on Databricks using GitLab and dbt, streamlining deployment and improving development efficiency.
– Developed and integrated a Unity Catalog and Hive metastore synchronization mechanism to enable table visibility in the Dremio Hive Catalog instance.
– Engineered end-to-end batch data pipelines to consolidate and process data from multiple sources using PySpark, SQL, and Python, ensuring data quality and scalability.
– Migrating legacy data pipelines from Microsoft Azure, Pentaho to GCP using Big Data technologies (Apache Spark) to enhance scalability, performance, and cost-efficiency.
Certifications & Licences
-
2020
Python for Data Science
CourseID: - https://academy.ineuron.ai/certificates/downloads/PY002612.pdf