AI Experience Researcher, Product Evaluation, Vision Products Group

What you'll do

• Develop scalable automated evaluation methodologies for AI experiences.
• Create comprehensive evaluation plans including scope, validation strategies, and timelines.
• Design experimental setups and write instructions for both LLM judges and human raters.
• Curate datasets that reflect realistic usage scenarios to support product goals.
• Analyze automated evaluations rigorously and present findings to diverse stakeholders.

What we're looking for

• Advanced degree in Cognitive Psychology, HCI, UX Research, Learning Sciences, Psychometrics, or Applied Behavioral Science.
• Strong data-driven mindset and experience designing rigorous empirical research or evaluation.
• Ability to translate theoretical grounding into practical evaluation frameworks and measurement designs.
• Proficiency in data analysis with a focus on statistical validity in evaluation contexts.
• Exceptional collaboration skills working effectively in cross-functional teams including engineering and design.
• Strong communication skills for translating complex findings into clear recommendations for diverse audiences.