Director, Data Science and Insights

What you'll do

• Define the evaluation strategy for measuring quality across Apple Intelligence, Siri, and other large-scale software features.
• Lead a large team of data scientists and machine learning engineers through recruiting, development, and retention.
• Drive methodologies for human evaluation, logging, A/B testing, and LLM-based autograders to improve model performance.
• Partner with product teams to integrate evaluation results into development cycles to achieve measurable quality gains.
• Collaborate with peer leaders in AI models, machine translation, and synthetic data to align technical goals.
• Represent the team and report findings to executive leadership across AIML and software engineering divisions.

What we're looking for

• 10+ years of experience in data science and machine learning evaluation.
• 6+ years of experience leading large technical teams.
• Advanced degree in a quantitative field such as Statistics, Computer Science, or Machine Learning.
• Demonstrated track record of running organizations of 50+ data scientists and/or machine learning engineers.
• Deep experience in human evaluation methodology, logging, and A/B testing for consumer-facing products at scale.
• Hands-on experience building and deploying LLM-based autograders and rubrics to improve models and agentic features.
• Experience evaluating large consumer AI products like conversational assistants, search systems, or agentic features.
• Strong written and verbal communication skills to engage with engineers and senior executive leadership.