Back to Job Listings

Machine Learning Engineer: Evaluation

San Francisco

SpringCube

Full-time - Senior Engineer

Professional & Business Services

Posted 3 weeks ago

Disclosed upon interview

Contact Employer
  • Share:
Send Feedback
Report This Job

Job Description

This job was selected by the SpringCube team to help AI, Data and Cloud Engineers discover relevant San Francisco Bay Area employers. Sign up to view the full employer details and apply directly with the hiring company.

Company Overview

The company develops autonomous technology for the construction and heavy equipment industries. Its platform integrates artificial intelligence and autonomous systems into existing construction machinery to improve productivity, safety, and operational efficiency. Its engineering team applies expertise in robotics, machine learning, and real-world autonomous systems to address complex challenges across construction environments.

Job Description

The Machine Learning Engineer: Evaluation will develop and maintain evaluation systems for complex machine learning and autonomous systems operating in real-world construction environments.

This role focuses on translating the complexity of physical job sites into measurable, AI-driven evaluation frameworks that accelerate system development and adoption. The engineer will design statistical testing methods, build performance measurement pipelines, and analyze results across simulations, hardware-in-the-loop systems, and real-world operational data.

The successful candidate will bring hands-on experience evaluating production machine learning systems, working with large datasets, and identifying performance differences between system iterations. This position will play an important role in improving autonomous system reliability and informing deployment decisions.

Responsibilities

  • Design and Maintain Evaluation Systems: Build pipelines to measure system performance across open-loop and closed-loop simulations, hardware-in-the-loop environments, and field data collected from autonomous construction machinery.
  • Streamline Evaluation Workflows: Develop efficient evaluation processes that help engineering teams identify performance insights earlier in the development lifecycle.
  • Develop Performance Metrics: Translate product objectives and real-world operating requirements into measurable indicators derived from logged system data.
  • Support Data-Driven Decisions: Analyze performance metrics and provide objective insights that inform parameter tuning, engineering improvements, and broader program planning.
  • Classify Data Sources: Develop infrastructure and classification systems that automatically annotate data and generate datasets for different machine learning training and evaluation applications.
  • Leverage AI for Data Annotation: Apply machine learning models to generate detailed annotations across large datasets, accelerating model development and evaluation.
  • Predict System Performance: Build models and interpret metrics from multiple data sources, including raw sensor data and key performance indicators.
  • Assess Deployment Readiness: Identify potential challenges associated with new construction sites and evaluate their impact on autonomous system performance and deployment decisions.
  • Collaborate Across Engineering Teams: Work with multidisciplinary teams to improve evaluation methodologies and translate analytical findings into practical system improvements.

Qualifications

  • Senior- or Staff-level engineering experience, with at least 5 years of professional experience in software engineering, data science, or research.
  • At least 2 years of professional experience analyzing the performance of modern machine learning or robotics systems in real-world applications.
  • Proficiency in Python.
  • Experience using a data warehouse query language.
  • Familiarity with developing and operating infrastructure within parallelized, cloud-based computing frameworks.
  • Strong statistical analysis capabilities, including classification, model-fit and bias assessment, hypothesis testing, and uncertainty quantification.
  • Experience working with large-scale datasets.
  • Ability to evaluate complex machine learning systems and translate performance findings into actionable technical insights.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals globally.

  1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
  2. No Client Relationship: This company is not a client of SpringCube unless stated.
  3. To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
  4. No Liability: SpringCube is not liable for inaccuracies.
‹