Machine Learning Engineering Manager, Agentic Search Evaluation

What you'll do

• Lead a team of engineers to build scalable, automated systems for end-to-end evaluation of personalized Agentic Search.
• Design and implement offline and online metrics to assess quality for Personal Question Answering.
• Develop data generation and curation methods to support evaluation systems.
• Create metrics frameworks for quality assessment and continuous product improvement.
• Define the long-term technical vision for personalized Siri Search quality and identify roadmap gaps.
• Coordinate with partner teams to define data requirements and set priorities for the Personal Question Answering stack.

What we're looking for

• 6 or more years of industry experience building machine learning or machine learning evaluation systems at scale.
• 2 or more years of industry experience in technical leadership or management.
• Knowledge of machine learning fundamentals, neural network architectures, and software engineering in Python or C/C++.
• Bachelor's degree in Computer Science, Engineering, Statistics, or a related field.
• Communication and collaboration skills.
• Experience designing and building production machine learning systems in search, NLP, recommendation systems, or information retrieval (preferred).
• Experience in data collection, data generation, or data quality assessment of language, image, or multimodal data (preferred).
• Advanced degree (Master's or Ph.D.) in Computer Science, Engineering, Statistics, or a related field, or equivalent industry experience (preferred).