Senior Software Engineer, Evaluation Flywheel, Autonomous Vehicles

What you'll do

• Own the architecture and strategy for converting road and simulation data into curated golden datasets.
• Establish standards for evaluation quality including dataset versioning, metric performance measurement, and release processes.
• Build self-serve tools and pipelines to help metric developers iterate quickly on evaluation tasks.
• Serve as the primary voice of evaluation quality in cross-team technical decisions and trade-offs.
• Partner with AI model developers to integrate vision-language models and agentic techniques into the evaluation workflow.
• Develop production-scale data engineering pipelines for evaluating large-scale machine learning systems.
• Manage the end-to-end lifecycle of the "eval flywheel" to ensure results are trusted by internal stakeholders.

What we're looking for

• BS or MS in Computer Science, Robotics, or a related field (or equivalent experience).
• 12+ years of experience building software.
• Significant experience in autonomous vehicles, robotics, or large-scale ML systems.
• Deep experience evaluating ML or robotic systems including metric design and ground-truth curation.
• Strong Python and data engineering skills for production-scale pipelines.
• Proven track record of independent execution and technical leadership across team boundaries.
• Experience with closed-loop simulation evaluation for autonomous driving is preferred.
• Experience applying LLMs or VLMs to evaluation or infrastructure is preferred.