Principal Technical Program Management, AI Infrastructure

Microsoft

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
—
Salary
$142,800–$274,800 / yr
Posted
6 days ago
Freshness
Confirmed live yesterday
Closes
Mar 16, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $207k
This role $209k
$127k most similar roles pay here $291k

This role pays more than 55% of similar roles. Most pay $177,250–$236,062 — the shaded band above. At the midpoint, this role pays about $209k versus about $207k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 588 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 570 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Technical Program Management, AI Infrastructure

As a Principal Technical Program Management, AI Infrastructure, you will join the AI Infrastructure team to accelerate the transition and scaling of Generative AI models. You will be responsible for the platform roadmap, managing end-to-end product development from research to production while ensuring the stability of multi-node GPU infrastructure and fleet efficiency for inference and training workloads. Your daily work involves translating business goals into technical requirements, defining performance indicators, and collaborating with cross-functional teams including Engineering, Research, and Product Marketing. You will navigate ambiguity to deliver features for the AI Foundry and other services. The role requires expertise in distributed computing systems, GPU, VM, OS, and cloud infrastructure fundamentals. Preferred skills include experience with Python for machine learning, ML platforms, and building products for developers within Azure, AWS, or Google Cloud environments.

What you'll do

  • Deliver a world-class AI infrastructure stack to host AI Foundry services.
  • Manage the platform roadmap to scale AI workloads from research into production environments.
  • Own a product area by defining requirements and managing end-to-end development, launches, and iterations.
  • Translate business goals into technical requirements and user experiences in collaboration with cross-functional teams.
  • Define performance indicators and oversee experiments to measure success using data and research.
  • Navigate ambiguity to drive clarity across complex, multi-stakeholder initiatives.
  • Manage the scalability, stability, and efficiency of multi-node GPU infrastructure for training and inference workloads.

What we're looking for

  • Bachelor's degree and 6+ years of experience in engineering, product/technical program management, data analysis, or product development.
  • 3+ years of experience managing cross-functional and/or cross-team projects.
  • Ability to pass the Microsoft Cloud background check.
  • 8+ years of experience designing and shipping complex products for developers or ML professionals (preferred).
  • 3+ years of experience with distributed platform ecosystems such as multi-tenant, real-time processing, or batch computing (preferred).
  • Proven experience in technical program management, preferably in AI infrastructure or cloud services (preferred).
  • Strong understanding of GPUs, VM, OS, and cloud infrastructure fundamentals (preferred).
  • Experience with Python for machine learning, ML platforms, and major cloud providers like Azure, AWS, or Google Cloud (preferred).

More like this

Similar roles

Principal Technical Program Manager, CoreAI

Microsoft

49 days ago $142,800–$274,800
Azure Capacity Planning Demand Forecasting Cloud Infrastructure Distributed Systems AI Infrastructure Data Analysis Governance Metrics
6+ yrs exp

Principal Technical Program Manager

Microsoft

Redmond, WA 107 days ago $142,800–$274,800
AI SimShip Program Management Data Analysis Localization Compliance Product Development
6+ yrs exp

Principal Technical Program Manager

Intuit

Mountain View, CA 62 days ago $238,000–$322,000
Data Lakehouse Databricks Snowflake BigQuery Kafka Flink CDP MarTech API Design AI/ML Agile Scrum SAFe PMP Data Mesh
10+ yrs exp

Principal Product Manager, AI Infrastructure

Microsoft

Remote 12 days ago $142,800–$274,800
AI Cloud Infrastructure Distributed Systems Platform Engineering Software Development Automation Telemetry Lifecycle Management Technical Program Management Architecture
8+ yrs exp Remote

Principal Technical Program Manager, AI

Motorola Solutions

Remote 6 days ago $160,000–$220,000
Artificial Intelligence Machine Learning MLOps Computer Vision Data Platforms Video Processing Inference Optimization KPIs OKRs Analytics
10+ yrs exp Remote