Senior Software Engineer, Evaluation Flywheel

Nvidia

Confirmed live yesterday High trust

Remote

Quick summary

Work type: Remote
Location: Santa Clara, CAGADCNCWA
Employment: Full-time
Posted: 59 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $207k

$158k $263k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $177,297–$235,750.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, Evaluation Flywheel

Role Posting Log in to save

JOB TITLE: Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles The Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles joins the AV Evaluation team to own the architecture and quality of the evaluation flywheel. This role involves building the engine that transforms road and simulation driving data into curated golden datasets while establishing metrics for precision and recall. You will develop self-serve dataset pipelines, quality reporting tools, and release processes to ensure dependable results for the self-driving stack. The position requires technical leadership to partner with test engineering and behavior planning teams to integrate vision-language models and agentic techniques into evaluation. Key requirements include a BS or MS in Computer Science or Robotics, 12+ years of software experience, and deep expertise in ML metric design, data engineering, and Python for production-scale pipelines.

What does a Software Engineer earn in California?

Median $214500 from 1193 postings across 76 companies.

See salary data

Skills

Python Data Engineering VLM Autonomous Vehicles Robotics Data Pipelines Metric Design Precision Recall Simulation Closed-loop Evaluation Dataset Curation

What you'll do

Own the architecture and strategy for the evaluation flywheel to convert driving data into curated golden datasets.
Define and measure performance metrics such as precision and recall to ensure evaluation results are trustworthy.
Manage the curation, versioning, and health of golden datasets and release processes.
Build self-serve dataset pipelines and quality reporting tools for metric developers and partners.
Partner with cross-functional leaders to manage trade-offs and represent evaluation quality in technical decisions.
Work directly with AI model developers to accelerate evaluation iteration for VLM-based systems.

What we're looking for

BS or MS in Computer Science, Robotics, or a related field (or equivalent experience).
12+ years of experience building software.
Significant experience in autonomous vehicles, robotics, or large-scale ML systems.
Deep experience evaluating ML or robotic systems, including metric design and golden dataset curation.
Strong Python and data engineering skills for production-scale pipelines.
Track record of independent execution and technical leadership across team boundaries.
Experience building an evaluation flywheel, including dataset curation and developer tooling (preferred).
Experience with closed-loop simulation evaluation for autonomous driving (preferred).

Save