Back to Job Listings

Senior Data Engineer

San Francisco

SpringCube

Full-time - Senior Engineer

Healthcare, Biotech, Pharma & Life Sciences

Posted 4 weeks ago

$160,000 - $200,000

Contact Employer
  • Share:
Send Feedback
Report This Job

Job Description

The SpringCube team curated the following job opportunity to help you in your job search. Explore the position below to find your next career move.

Company Overview
A fast-growing advertising technology company is seeking a Senior Data Engineer to help build scalable data infrastructure that powers advanced reporting and measurement solutions. The organization leverages AI, machine learning, and large-scale analytics to modernize television advertising, enabling businesses to make data-driven marketing decisions through innovative technology platforms.

Summary
The Senior Data Engineer will design, build, and maintain large-scale data pipelines that transform high-volume raw data into production-ready datasets. This role involves collaborating closely with data science, engineering, and product teams to deliver reliable, high-quality data products that support reporting, analytics, and business intelligence initiatives.

Responsibilities

  • Design, build, and own scalable ETL pipelines for processing large volumes of data
  • Transform raw data into curated, production-grade datasets for reporting and measurement products
  • Partner with data science teams to implement and validate analytical methodologies
  • Collaborate with backend and frontend engineers to develop efficient data-serving solutions
  • Work with product teams to translate business requirements into technical specifications
  • Ensure data quality through validation, reconciliation, and comprehensive testing processes
  • Optimize distributed data systems for performance, scalability, and reliability
  • Develop and maintain data models, schemas, partitioning strategies, and data contracts
  • Manage workflow orchestration, including pipeline scheduling, backfills, and failure recovery
  • Contribute to technical documentation, incident analysis, and continuous process improvements
  • Stay informed about emerging technologies, including AI-assisted software development and agentic engineering workflows

Qualifications

  • 5+ years of experience designing, building, and operating production ETL pipelines at scale
  • Strong programming skills in Python (or a similar language) and SQL
  • Hands-on experience with Spark or PySpark for large-scale data processing
  • Experience with modern data platforms such as Databricks and Delta Lake
  • Proficiency with workflow orchestration tools such as Airflow, including DAG design and pipeline management
  • Strong understanding of data modeling, schema design, partitioning, and analytics datasets
  • Experience ensuring data quality through validation, reconciliation, and methodology comparisons
  • Ability to troubleshoot and optimize distributed data systems for performance and scalability
  • Excellent written communication and cross-functional collaboration skills
  • Experience with OLAP databases such as ClickHouse is a plus
  • Interest in AI-assisted development, agent workflows, and modern software engineering practices is an advantage

Disclaimer
SpringCube curates tech job listings from various company websites to support tech professionals globally.

1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
2. No Client Relationship: This company is not a client of SpringCube unless stated.
3. To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
4. No Liability: SpringCube is not liable for inaccuracies.

‹