AI Experience Researcher, Product Evaluation, Vision Products Group

What you'll do

• Develop scalable automated evaluation methodologies for AI experiences.
• Create comprehensive evaluation plans including scope, validation strategies, and timelines.
• Derive experimental designs and write test instructions for both LLM judges and human raters.
• Define requirements and curate datasets representing realistic usage scenarios.
• Implement and analyze automated evaluations to identify key insights and areas for improvement.
• Present clear, concise evaluation findings with actionable recommendations to diverse stakeholders.

What we're looking for

• Advanced degree in Cognitive Psychology, HCI, UX Research, Learning Sciences, Psychometrics, Applied Behavioral Science, or related field.
• Strong data-driven mindset with experience designing and conducting rigorous empirical research.
• Ability to translate theoretical grounding into evaluation frameworks and measurement designs.
• Proficiency in data analysis and statistical validity in evaluation contexts.
• Exceptional collaboration skills working effectively in cross-functional teams.
• Strong communication skills for translating complex findings into actionable recommendations.