Principal Technical Program Manager

What you'll do

• Own the long-term vision and roadmap for Bing's offline quality metrics ecosystem.
• Define measurement strategies for AI-powered search, ranking systems, retrieval, and multimodal content.
• Partner with Data Science and Research teams to create robust, trustworthy, and actionable quality metrics.
• Drive metric validation, calibration, and governance frameworks to ensure offline metrics predict user value.
• Build diagnostic frameworks to translate measurement scores into concrete product investment opportunities.
• Provide actionable recommendations to engineering and leadership teams for product development and launch readiness.
• Research and implement advances in LLM evaluation, human-in-the-loop, and synthetic evaluation approaches.

What we're looking for

• Bachelor's Degree and 6+ years of experience in engineering, product/technical program management, data analysis, or product development.
• 3+ years of experience managing cross-functional and/or cross-team projects.
• Bachelor's Degree and 12+ years of experience in engineering, product/technical program management, data analysis, or product development (preferred).
• Experience defining or operating metrics used for large-scale product decisions (preferred).
• Demonstrated ability to lead cross-functional initiatives across multiple teams (preferred).
• Solid analytical and quantitative problem-solving skills (preferred).
• Excellent communication and stakeholder management abilities (preferred).
• Experience in search, recommendation systems, ranking, AI products, or large-scale consumer experiences (preferred).