Microsoft AI is seeking a Senior Engineering Leader to build and lead a high-performing engineering organization responsible for Copilot AI Evaluation. This role involves hiring and developing engineering managers, setting technical and organizational strategy, and delivering large-scale evaluation platforms and techniques. The leader will partner with senior engineering and product leadership to define priorities and drive cross-organizational initiatives, ensuring the quality of Copilot at scale. Ideal candidates have extensive experience in building and scaling AI-focused engineering teams, managing 30+ engineers across multiple teams, and a deep understanding of LLM evaluation and ML infrastructure. They should possess strong technical judgment, operational rigor, and the ability to foster a diverse and inclusive team culture. This role demands expertise in AI quality measurement, software systems delivery, and leadership in fast-paced environments.
Skills
LLM
AI
Machine_Learning
Engineering_Management
Software_Systems
Recruiting
Developing_Talent
Technical_Judgment
Distributed_Teams
CI/CD
Python
Java
C++
SQL
Azure
GitHub
JIRA
Confluence
Slack
Zoom
What you'll do
Build and lead a multi-team engineering organization of 30+ engineers, including hiring managers who lead their own teams.
Set technical and organizational strategy for Copilot AI Evaluation, aligning with MAI’s broader vision.
Partner with senior leadership to define priorities, influence roadmaps, and drive cross-organizational initiatives.
Own end-to-end delivery of evaluation platforms and techniques for measuring and improving Copilot quality at scale.
Recruit, develop, and retain world-class engineering talent, fostering a culture of technical excellence and continuous learning.
What we're looking for
12+ years of technical engineering experience with at least 6+ years in engineering management.
Bachelor's Degree in Computer Science or related field required; advanced degree preferred.
Proven track record of building and scaling engineering organizations, including hiring managers.
Experience delivering large-scale software systems in AI, machine learning, or related fields.
Deep expertise in LLM evaluation, AI quality measurement, or ML infrastructure at scale.
Track record of partnering with senior leadership to set strategy and drive cross-organizational programs.
Strong ability to operate effectively in fast-paced environments, making decisions with incomplete information.
Market check
Salary context
This
$139,900–$274,800
range sits above
71%
of similar postings on FindRole.
Peer median band
$139,900–$244,000
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$167,500–$214,375
Middle half of comparable postings.
Based on 238 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
451 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 417 roles with salary data.