Senior Manager, Evaluation, Data Science & Insights

What you'll do

• Own the evaluation roadmap by translating organizational strategy into concrete methods and deliverables.
• Recruit, develop, and retain a team of high-performing data scientists and technical talent.
• Execute human evaluation methodologies and build LLM-based autograders and rubrics.
• Use evaluation tools to drive measurable improvements in models and agentic features.
• Partner with product teams to embed evaluation into development cycles and ship quality gains.
• Represent the team's work and results to senior leadership across AIML and SWE.

What we're looking for

• 6+ years of experience in data science and machine learning evaluation.
• 3+ years of experience leading technical teams.
• Advanced degree in a quantitative field such as Statistics, Computer Science, Machine Learning, or similar.
• Demonstrated track record of running teams of 7+ data scientists and/or machine learning engineers.
• Strong experience in human evaluation methodology for consumer-facing products at scale.
• Hands-on experience building and deploying LLM-based autograders and rubrics to drive improvements in models and agentic features.
• Strong written and verbal communication skills to communicate with engineers and senior leaders.
• Experience evaluating large consumer AI products, logging infrastructure, or agentic systems (preferred).