Director, Data Science and Insights

What you'll do

• Define the evaluation strategy for measuring quality across Apple Intelligence, Siri, and other large-scale software features.
• Lead a large team of data scientists and machine learning engineers through recruiting, development, and retention.
• Drive methodologies for human evaluation, logging, A/B testing, and LLM-based autograders to improve model performance.
• Partner with product teams to integrate evaluation into development cycles and translate results into quality gains.
• Collaborate with peer leaders across AIML platforms to align on foundation models and machine translation goals.
• Represent the team and report findings to executive leadership including Senior Vice Presidents.

What we're looking for

• 10+ years of experience in data science and machine learning evaluation.
• 6+ years of experience leading large technical teams.
• Advanced degree in a quantitative field such as Statistics, Computer Science, or Machine Learning.
• Demonstrated track record of running organizations of 50+ data scientists and/or machine learning engineers.
• Deep experience in human evaluation methodology, logging, and A/B testing for consumer-facing products at scale.
• Hands-on experience building and deploying LLM-based autograders and rubrics to improve models and agentic features.
• Strong written and verbal communication skills to engage with engineers and senior leadership.
• Experience evaluating large consumer AI products like conversational assistants, search systems, or agentic features.