Lead Forward Deployed Engineer, AI Evaluation Platform

What you'll do

• Translate novel metrics and scoring algorithms into scalable, production-grade services.
• Integrate evaluation primitives and SDKs into unique workflows for various feature teams.
• Gather actionable signal on API quality and developer experience to inform the product roadmap.
• Build demos, tutorials, and reference implementations to showcase evaluation best practices.
• Partner with Science and Platform Engineering to connect high-level strategy to daily execution plans.
• Operationalize sophisticated measurement techniques for ML practitioners across the organization.
• Transition the organization from a consulting model to a self-service evaluation model.

What we're looking for

• 5+ years of experience in Solutions Architecture, Forward-Deployed Engineering, Developer Advocacy, Technical Program Management, or a related highly technical role.
• Experience acting as a technical partner to internal customers to translate vague requirements into concrete engineering specifications.
• Functional literacy in AI/ML concepts including datasets, training vs. inference, and evaluation metrics.
• Demonstrated experience partnering with Applied Scientists or Researchers to navigate research workflows and operationalize scientific code.
• Exceptional communication skills to represent the platform to executive leadership and the broader engineering community.
• Demonstrated ability to navigate extreme ambiguity, define roadmaps, and influence without direct authority.
• Deep familiarity with AI Evaluation Frameworks like DeepEval, Ragas, TruLens, or LangSmith (preferred).
• Experience designing research or tools with self-service adoption as a first-class constraint (preferred).