Job Description
This job was selected by the SpringCube team to help AI, Data and Cloud Engineers discover relevant San Francisco Bay Area employers. Sign up to view the full employer details and apply directly with the hiring company.
Company Overview
The company provides research, analytics, and advisory services that help organizations understand people, workplace dynamics, and consumer behavior. Its teams rely on data-driven products and research capabilities, supported by modern data infrastructure, analytics systems, and emerging AI technologies.
Responsibilities
- Design and implement reliable, scalable data pipelines to ingest, process, and deliver structured and unstructured data across the organization.
- Build transformation pipelines that convert raw data into high-quality datasets for analytics and experimentation.
- Implement layered data models, from raw and curated data to semantic models, supporting analytics, experimentation, and AI/ML workflows.
- Maintain data reproducibility, lineage, and traceability throughout data processing workflows.
- Translate architectural patterns into production-ready pipelines, data models, and infrastructure.
- Design data systems for reliability, scalability, and maintainability in complex and evolving environments.
- Implement monitoring, alerting, automated data quality checks, and observability mechanisms.
- Support incident response, conduct root cause analysis, and implement operational improvements.
- Establish and contribute to standards for data modeling, pipeline design, and operational workflows.
- Collaborate with product managers, analysts, data scientists, and software engineers to understand data requirements and deliver scalable solutions.
- Help teams transition from manual processes and legacy workflows to automated, modern data systems.
- Mentor other engineers through code reviews, technical guidance, and architectural discussions.
Qualifications
- A bachelor’s or master’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- At least 5 years of experience in data engineering or backend engineering focused on data systems.
- Strong SQL skills and a deep understanding of data modeling.
- Experience designing, deploying, and operating production data pipelines.
- Experience with orchestration tools such as Apache Airflow or Dagster.
- Experience with dbt workflows or comparable data transformation frameworks.
- Hands-on experience with cloud data platforms such as Snowflake, Databricks, or BigQuery.
- Strong programming skills in Python or a similar language.
- Experience implementing data quality, monitoring, or observability frameworks.
- Ability to work on-site at the company’s San Francisco office at least three days per week.
Preferred Qualifications
- Experience leading or contributing to data platform modernization projects or migrations from legacy environments.
- Experience working with AWS.
- Experience partnering directly with nontechnical stakeholders and influencing business decisions through technical expertise.
- Experience collaborating with AI teams in environments where data quality, reproducibility, and reliable data access are critical.
Key Competencies
- Execution Excellence: Demonstrated ability to build and operate production data systems and maintain reliable pipelines at scale.
- Practical Problem-Solving: Strong engineering judgment when working with incomplete documentation, legacy workflows, and changing requirements.
- Modern Data Engineering: Proficiency in data ingestion, transformation pipelines, and layered data modeling, with the ability to turn architectural direction into clean, production-ready implementations.
- Cross-Functional Collaboration: Ability to translate business requirements into scalable technical capabilities while partnering effectively with product, analytics, and engineering teams.
- AI-Oriented Mindset: Curiosity about AI and modern engineering tools, with an understanding of how data modeling and accessibility support AI systems and reproducible workflows.
Disclaimer
SpringCube curates tech job listings from various company websites to support tech professionals globally.
- No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
- No Client Relationship: This company is not a client of SpringCube unless stated.
- To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
- No Liability: SpringCube is not liable for inaccuracies.