AI Experience Researcher, Product Evaluation, Vision Products Group

What you'll do

• Develop scalable automated evaluation methodologies for AI experiences.
• Produce comprehensive evaluation plans including scope, validation strategies, and timelines.
• Derive experimental designs and write test instructions for both LLM judges and human raters.
• Define requirements and curate datasets that represent realistic usage scenarios.
• Implement and analyze automated evaluations to identify key insights and areas for improvement.
• Present clear, concise evaluation findings to diverse stakeholders with actionable recommendations.

What we're looking for

• Advanced degree in Cognitive Psychology, HCI, UX Research, Learning Sciences, Psychometrics, or Applied Behavioral Science.
• Strong data-driven mindset with experience designing and conducting rigorous empirical research.
• Ability to translate theoretical grounding into evaluation frameworks and measurement designs.
• Proficiency in data analysis and statistical validity for evaluations.
• Exceptional collaboration skills working effectively in cross-functional teams.
• Strong communication skills to convey complex findings to both technical and non-technical audiences.