Back to Job Listings

Lead Data Engineer

San Francisco

SpringCube

Full-time - Principal Engineer

IT Services & Consulting

Posted 3 weeks ago

Disclosed upon interview

Contact Employer
  • Share:
Send Feedback
Report This Job

Job Description

The SpringCube team curated the following job opportunity to help you in your job search. Explore the position below to find your next career move.

Company Overview

A leading professional services organization is seeking a Lead Data Engineer to support the design, development, and delivery of modern data and analytics solutions across a variety of industries. The organization helps businesses modernize their data ecosystems by implementing scalable cloud-based platforms, enabling advanced analytics, reporting, and data-driven decision-making. Teams work closely with business and technology stakeholders to deliver enterprise-scale solutions that improve how organizations manage and leverage data.

The organization is seeking a Lead Data Engineer with strong expertise in Databricks, cloud technologies, and modern data architectures. This role involves leading project teams, advising stakeholders, and delivering scalable data platform solutions that address complex business and technical requirements.

The ideal candidate will have experience designing and implementing data engineering solutions, managing project workstreams, and collaborating with clients to develop modern analytics capabilities. This position requires strong leadership, technical expertise, and the ability to guide teams through complex delivery engagements.

Key Responsibilities

  • Lead the design and delivery of Databricks-based data and analytics solutions for client engagements.
  • Manage project teams and workstreams across requirements gathering, solution design, development, testing, and deployment.
  • Translate business and technical requirements into scalable data pipelines, data models, and platform capabilities.
  • Advise stakeholders on architecture decisions, implementation strategies, and operating model considerations for modern data platforms.
  • Oversee solution quality, issue resolution, delivery progress, project economics, and timeline management.
  • Support the modernization of enterprise data environments through cloud-enabled technologies and scalable architectures.
  • Collaborate with business and technology teams to deliver analytics and reporting capabilities that drive business value.

Required Qualifications

  • Bachelor’s degree.
  • 6+ years of experience delivering data engineering, analytics, or cloud data platform solutions.
  • 3+ years of experience with Databricks and Apache Spark.
  • 3+ years of experience with Python and SQL.
  • 2+ years of experience leading project teams or workstreams.
  • Ability to travel up to 50%, depending on client and project requirements.
  • Strong written and verbal communication skills.
  • Ability to work independently and collaboratively in team environments.
  • Strong attention to detail and commitment to delivering high-quality work.
  • Excellent interpersonal and relationship-building skills.
  • Ability to manage multiple priorities in a fast-paced environment.
  • Proven ability to lead projects, provide guidance, and meet deadlines.

Preferred Qualifications

  • Master’s degree.
  • Experience with Delta Lake, Unity Catalog, or MLflow.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
  • Experience designing and implementing batch and streaming data pipelines.
  • Experience with data governance, data quality, or platform security controls.
  • Experience supporting client presentations, proposals, or solution demonstrations.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals globally.

  1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
  2. No Client Relationship: This company is not a client of SpringCube unless stated.
  3. To Apply: Click the Apply button to be redirected to the hiring company’s application page for this job.
  4. No Liability: SpringCube is not liable for inaccuracies.