AWS Senior Data Engineer

The SpringCube team curated the following job opportunity to help you in your job search. Explore the position below to find your next career move.

Company Overview

A leading technology organization is seeking an experienced AWS Senior Data Engineer to support the development and optimization of scalable cloud-based data infrastructure. The organization focuses on building reliable data solutions that enable efficient data integration, analytics, reporting, and business decision-making.

The successful candidate will bring strong hands-on expertise in data engineering, ETL, data warehousing, database design, and AWS data services. This role will focus on designing, developing, optimizing, and supporting scalable data pipelines throughout their development and production lifecycle.

Key Responsibilities

Data Integration & Pipeline Development

• Design, develop, and maintain data integration workflows using AWS Glue, EMR, MWAA/Airflow, Lambda, and Amazon Redshift.
• Build scalable ETL/ELT pipelines for processing large datasets.
• Use Python, PySpark, and Apache Spark for data transformation and processing.
• Ensure accurate and efficient extraction, transformation, and loading of data into target systems.
• Design and support data pipelines throughout the development and production lifecycle.

Data Quality & Integrity

• Validate, cleanse, and transform data to maintain high levels of data quality.
• Implement monitoring, validation, error-handling, and recovery mechanisms within data pipelines.
• Identify and resolve data quality and data integration issues.
• Maintain reliable and consistent data across integrated systems.

Performance & Cloud Optimization

• Optimize data workflows for performance, scalability, reliability, service-level agreements, and cost efficiency within AWS.
• Identify and resolve pipeline and data-processing bottlenecks.
• Tune SQL queries and optimize Amazon Redshift performance.
• Continuously review and improve existing data integration processes.

Business Intelligence & Analytics

• Translate business requirements into technical specifications and data pipelines.
• Ensure the timely availability of integrated data for analytics and reporting.
• Collaborate with data analysts, business stakeholders, and technical teams to understand and deliver data requirements.
• Develop data solutions that support business intelligence and analytical initiatives.

Documentation & Compliance

• Document data pipelines, workflows, architecture, technical specifications, and system processes.
• Follow data governance, security, compliance, and regulatory requirements.
• Maintain technical documentation throughout the development and production lifecycle.

Required Qualifications

• 5+ years of experience in data engineering, database design, ETL, and data warehousing.
• 3+ years of experience with AWS data services, including:
  • AWS S3
  • AWS EMR
  • AWS Glue
  • AWS Athena
  • Amazon Redshift
  • Amazon RDS
  • Redshift Spectrum
  • AWS MWAA / Airflow
• 2+ years of experience with CI/CD tools and practices.
• Strong knowledge of data storage, data lakes, databases, and distributed data-processing frameworks.
• Hands-on experience with Apache Spark, PySpark, or Hadoop.
• 3+ years of programming experience with Python, Java, or Scala.
• Experience designing, developing, and supporting production data pipelines.

Primary Skills

AWS EMR | AWS Glue | Airflow/MWAA | Apache Iceberg | Amazon Redshift | Amazon RDS | PySpark | Python | CI/CD

Nice to Have

• Experience with Informatica Cloud / IDMC.
• Experience with Agentic AI and Amazon Kiro.
• Experience with Apache Iceberg and modern data lake architectures.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals globally.

1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
2. No Client Relationship: This company is not a client of SpringCube unless stated.
3. To Apply: Click the Apply button to be redirected to the hiring company’s application page for this job.
4. No Liability: SpringCube is not liable for inaccuracies.