Back to Job Listings

ML Infra Engineer, Modeling

San Francisco

SpringCube

Full-time - Senior Engineer

Healthcare, Biotech, Pharma & Life Sciences

Posted 1 week ago

Disclosed upon interview

Contact Employer
  • Share:
Send Feedback
Report This Job

Job Description

This job was selected by the SpringCube team to help AI, Data and Cloud Engineers discover relevant San Francisco Bay Area employers. Sign up to view the full employer details and apply directly with the hiring company.

Company Overview

The company develops general-purpose artificial intelligence systems designed to operate in the physical world. Its multidisciplinary team of engineers, scientists, and robotics specialists builds foundation models and machine learning algorithms for robotics and other physically actuated devices. Its work focuses on advancing AI capabilities through scalable model development, research, and engineering infrastructure.

Job Description

The ML Infra Engineer, Modeling will help scale and optimize machine learning training systems and core model code. This role will own critical infrastructure supporting large-scale model training, including GPU and TPU compute management, job orchestration, and the development of reusable, efficient JAX training pipelines.

Working closely with researchers, model engineers, and infrastructure teams, the engineer will translate research concepts into experiments and production-scale training workflows. The position requires strong software engineering capabilities and practical experience building reliable, reproducible, and high-performance machine learning infrastructure.

Responsibilities

  • Own Training and Inference Infrastructure: Design, implement, and maintain systems for large-scale model training, including scheduling, job management, checkpointing, metrics, and logging.
  • Scale Distributed Training: Collaborate with researchers to scale JAX-based training workloads across TPU and GPU clusters while minimizing operational complexity.
  • Optimize Performance: Profile and improve memory utilization, device efficiency, training throughput, and distributed synchronization.
  • Enable Rapid Experimentation: Build reusable abstractions and tools for launching, monitoring, debugging, and reproducing machine learning experiments.
  • Collaborate with Researchers: Translate research requirements into infrastructure capabilities and establish best practices for large-scale model training.
  • Improve Core Training Code: Develop and maintain JAX model and training code to support new architectures, modalities, and evaluation metrics.
  • Support Production-Scale Training: Build infrastructure that enables models to progress reliably from research prototypes to production-grade training runs.

Qualifications

  • Strong software engineering fundamentals and experience building machine learning training infrastructure or internal engineering platforms.
  • Hands-on experience with large-scale model training using JAX, preferably, or PyTorch.
  • Familiarity with distributed training systems, multi-host environments, data loaders, and model evaluation pipelines.
  • Experience managing training workloads on cloud or cluster platforms such as SLURM, Kubernetes, Google Cloud TPU/GKE, or AWS.
  • Ability to identify, debug, and optimize performance bottlenecks across the machine learning training stack.
  • Strong cross-functional communication skills and a demonstrated sense of ownership.

Preferred Qualifications

  • Deep background in machine learning systems, including training compilers, runtime optimization, or custom kernel development.
  • Experience working close to hardware, particularly GPU and TPU performance tuning.
  • Background in robotics, multimodal machine learning models, or large-scale foundation models.
  • Experience designing infrastructure abstractions that balance researcher flexibility with system reliability and operational consistency.

Team Overview

The Machine Learning Infrastructure team supports core modeling and research initiatives by developing systems that make large-scale training reliable, reproducible, and efficient. The team works closely with research, data, and platform engineering groups to help models scale from early prototypes to production-ready training workflows.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals globally.

  1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
  2. No Client Relationship: This company is not a client of SpringCube unless stated.
  3. To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
  4. No Liability: SpringCube is not liable for inaccuracies.
‹