Senior Machine Learning Engineer, Evaluation, Agentic Search Capabilities

What you'll do

• Build scalable, automated systems for large-scale, end-to-end evaluation of models and search-powered systems.
• Design and implement novel data generation and data quality assessment methods for personal agentic search.
• Develop and implement offline and online metrics to assess product and component-level quality.
• Define data and evaluation requirements and priorities in coordination with partner teams.
• Develop a long-term technical vision for personal search quality and identify key problem areas.
• Drive solutions for the personal search stack as part of a larger technical roadmap.

What we're looking for

• 6+ years of industry experience building Machine Learning or ML evaluation systems at scale.
• Strong software engineering skills in mainstream programming languages such as Python or C/C++.
• Ability to quickly prototype ideas and solutions and perform critical analysis.
• Strong communication skills and the ability to drive solutions in collaboration with partner teams.
• Bachelor's degree in Computer Science, Engineering, Statistics, or a related field.
• Experience in design and building production ML systems in search, NLP, recommendation systems, or information retrieval (preferred).
• Experience in data collection, data generation, and/or data quality assessment of language, image, or multi-modal data (preferred).
• Advanced degree in Computer Science, Engineering, Statistics, or a related field, or equivalent industry work experience (preferred).