Senior Software Engineer, Autonomy Evaluation

What you'll do

• Architect and implement metrics to evaluate autonomous driving software performance across various subsystem interfaces.
• Develop analysis algorithms to aggregate and cluster data from both simulations and real-world road runs.
• Create new statistical and machine learning methods to identify behavior patterns across diverse operational domains.
• Build evaluation tools to inspect the performance of perception, prediction, and planning models.
• Create interactive dashboards and reports to provide clear, explainable insights for engineering teams and leadership.
• Utilize LLMs and VLMs to classify performance, identify critical scenarios, and prioritize validation efforts.
• Maintain high technical standards through rigorous code reviews, testing, and adherence to software engineering best practices.
• Collaborate with cross-functional partners to define requirements and share best practices regarding evaluation and experiment design.

What we're looking for

• 5+ years of experience in robotics or autonomous systems software, data analysis, ML evaluation, or autonomy analytics.
• 3+ years evaluating dynamic systems using numerical and/or ML approaches including time-series data and interconnected subsystems.
• Strong proficiency developing Python in production environments including testing, performance, and code review.
• Proficiency with Pandas, NumPy, SciPy, and plotting libraries for large-scale data analysis and reporting.
• Ability to read, debug, and instrument C++ codebases.
• Demonstrated technical leadership in driving architectural decisions and owning complex features end-to-end.
• Bachelor’s, Master’s, or PhD in Computer Science, Robotics, Engineering, Data Science, or a related field (or equivalent experience).