Manager, Applied AI Science - GenAI Model Autograding, Evaluation

What you'll do

• Lead and grow a high-performing team of applied AI scientists and machine learning engineers.
• Set the technical vision, roadmap, and methodology for autograder development and evaluation tools.
• Develop reliable, scalable LLM and VLM-based evaluation systems for product-quality decisions.
• Standardize and automate end-to-end evaluation workflows to enable scalable production.
• Translate emerging GenAI research into reliable, production-ready systems and frameworks.
• Manage the development of rubric design, evaluation set creation, and human-model alignment.
• Resolve cross-functional dependencies and align diverse stakeholders on technical strategies.

What we're looking for

• MS/PhD degree in Computer Science, Machine Learning, AI, or a related field.
• 1+ years of industry experience building LLM/VLM-based evaluators, autograders, or automated evaluation systems.
• 5+ years of hands-on experience in machine learning, model alignment, or benchmark creation.
• Track record of managing teams of 3+ machine learning engineers and/or AI scientists.
• Deep understanding of GenAI models and evaluation methodologies including rubric design, validation, and human-model alignment.
• Strong technical judgment and a track record of leading complex, ambiguous AI/ML projects from definition through delivery (preferred).
• Experience translating emerging GenAI techniques and research into reliable, production-ready systems (preferred).
• Experience scaling AI/ML solutions into reusable platforms, frameworks, or standardized workflows (preferred).