Principal Technical Program Manager, Applied Science

Microsoft

Quick summary

Work type: On-site
Location: US
Salary: $139,900–$274,800 / yr
Posted: 68 days ago
Nearby: 95 roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $185k

This role $207k

$124k most similar roles pay here $291k

This role pays more than 68% of similar roles. Most pay $161,983–$208,800 — the shaded band above. At the midpoint, this role pays about $207k versus about $185k for comparable roles.

Based on 239 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 668 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 615 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Technical Program Manager, Applied Science

Role Posting Log in to save

As a Principal Technical Program Manager on GitHub's Applied Science team for Copilot, you will lead the development of AI evaluation strategies from concept to execution. This includes translating cutting-edge research into production systems and designing adaptive testing frameworks that go beyond traditional benchmarks. You will oversee the creation of procedurally-generated code evaluations and community benchmark submission programs, ensuring transparency in model performance on real-world developer workflows. Additionally, you will establish multi-tier evaluation frameworks for rapid iteration and feedback-to-benchmark pipelines to convert user issues into actionable tests. The role requires deep expertise in AI/ML evaluation methodologies, software engineering workflows, and experience with AI coding tools like Copilot or similar products. You must be adept at managing cross-functional projects and building scalable evaluation systems that influence product decisions across GitHub's expansive developer platform.

Skills

Python JavaScript CI/CD LLM-as-judge A/B testing Adaptive Testing (IRT) Procedural Code Generation Telemetry-Driven Benchmarking GitHub Actions Kubernetes AWS PostgreSQL MMLU HumanEval SWE-Bench

What you'll do

Partner with researchers to translate cutting-edge evaluation research into production systems.
Lead the design of next-generation AI benchmarks that reflect real developer workflows.
Build and manage GitHub's community benchmark submission program for transparency reports.
Design multi-tier evaluation frameworks enabling rapid iteration on AI features.
Convert user feedback into automated regression tests for continuous improvement.
Establish evaluation as a core discipline, ensuring results are accessible to all teams.

What we're looking for

5+ years of experience in technical program management or related field.
2+ years managing programs in machine learning and AI/ML evaluation.
Deep firsthand experience with AI/ML evaluation methodologies, including benchmark design and automated scoring systems.
Personal experience using AI coding tools like GitHub Copilot daily.
Understanding of software engineering workflows at scale and integration of AI tools.
Experience managing community or open-source program initiatives.
Proven ability to navigate competing priorities and build commitment across teams.

Similar roles

Senior Technical Program Manager, Applied Science

Microsoft

74 days ago $119,800–$234,700

GitHub VS Code Python JavaScript CI/CD Kubernetes Docker AWS Azure Google Cloud Platform PostgreSQL MongoDB Git Jira Confluence Terraform Prometheus Grafana GDPR CCPA EU AI Act

Save

Senior Principal Software Engineer, Growth (CoreAI)

Microsoft

135 days ago $119,800–$234,700

Python JavaScript A/B testing CI/CD Kubernetes AWS Azure Docker PostgreSQL Redis Git GitHub Visual Studio Code Terraform Prometheus Grafana Scalability Performance tuning Experimentation methodologies

Save

Principal Technical Program Manager

Oracle

Nashville, TN 67 days ago $90,100–$199,500

Oracle AWS Kubernetes Terraform Python PostgreSQL CI/CD Docker Prometheus Grafana AI HPC Data Center GPU Architecture Cloud Architecture Agile Methodology

Save

Principal Technical Program Manager

Oracle

Nashville, TN +1 40 days ago $90,100–$199,500

Oracle AWS Kubernetes Terraform Python PostgreSQL CI/CD Docker Prometheus Grafana AI HPC Data Center GPU architecture Cloud Architecture Agile Methodologies

Save

Principal Technical Program Manager

Microsoft

US 37 days ago $142,800–$274,800

Azure Kubernetes CI/CD Docker Terraform PostgreSQL Python JavaScript Networking Photonics Optics Advanced_Packaging Co_Packaged_Optics Memory_Hierarchies Hardware_Simulation Modeling_Tools

Save

Principal Technical Program Manager

Oracle

26 days ago $90,100–$209,500

AWS Azure OCI GCP Cloud Architecture Distributed Systems AI Machine Learning Generative AI Automation Frameworks Program Management Agile Methodologies Metrics and KPI Management Data-Driven Decision Making Technical Problem Solving Risk Management Continuous Improvement Cross-Functional Leadership

Save