Senior Technical Program Manager, AI Infrastructure

Microsoft

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
—
Salary
$119,800–$234,700 / yr
Posted
2 days ago
Freshness
Confirmed live yesterday
Closes
Mar 30, 2027

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $205k
This role $177k
$104k most similar roles pay here $267k

This role pays less than 72% of similar roles. Most pay $177,250–$233,600 — the shaded band above. At the midpoint, this role pays about $177k versus about $205k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 597 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 570 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior Technical Program Manager, AI Infrastructure

As a Senior Technical Program Manager, AI Infrastructure, you will join the AI Infrastructure team to accelerate the transition and scaling of Generative AI models. You will be responsible for the platform roadmap to move AI workloads from research into production while managing the multi-node GPU infrastructure required for inference and training. Your daily work involves defining product requirements, managing end-to-end development cycles, and translating business goals into technical specifications in collaboration with engineering, data science, and research teams. You will navigate complex projects involving distributed computing systems and cloud infrastructure to ensure fleet efficiency and reliability. The role requires expertise in GPU, VM, OS, and cloud fundamentals, along with proficiency in Python for machine learning. You will solve critical problems regarding the scalability of high-demand AI workloads within a fast-paced, customer-focused development environment.

What does a Technical Program Manager earn?

Median $190350 from 211 postings across 36 companies.

See salary data

What you'll do

  • Deliver a world-class AI infrastructure stack to host AI Foundry Services.
  • Manage the platform roadmap to scale AI workloads from research into production.
  • Own a product area by defining requirements and managing end-to-end development, launches, and iterations.
  • Translate business goals into technical requirements and user experiences in collaboration with cross-functional teams.
  • Define performance indicators and oversee experiments to measure success using data and research.
  • Navigate roadblocks to deliver features to customers quickly and iteratively.
  • Manage the stability of multi-node GPU infrastructure for training and inference workloads.

What we're looking for

  • Bachelor's degree and 4+ years of experience in engineering, product/technical program management, data analysis, or product development.
  • At least 2 years of experience managing cross-functional and/or cross-team projects.
  • Ability to pass the Microsoft Cloud background check.
  • 8+ years of experience designing and shipping complex products for developers or ML professionals (preferred).
  • 3+ years of experience with distributed platform ecosystems such as multi-tenant, real-time processing, or batch computing (preferred).
  • Proven experience in technical program management, preferably in AI infrastructure or cloud services (preferred).
  • Strong understanding of GPUs, VM, OS, and cloud infrastructure fundamentals (preferred).
  • Experience with Python for machine learning, ML platforms, and major cloud providers like Azure, AWS, or Google Cloud (preferred).

More like this

Similar roles

Senior Technical Program Manager

Microsoft

11 days ago $119,800–$234,700
Quantum Computing Azure Agile Cryoelectronics High-Performance Computing Artificial Intelligence Firmware Control Systems ASICs Data Analysis Copilots Generative AI Risk Management
4+ yrs exp Hybrid

Senior Technical Program Manager, AI Acceleration

Nvidia

Santa Clara, CA 95 days ago $168,000–$258,750
AI LLM ASIC RTL Design Simulation Formal Verification System Architecture Scalable Infrastructure Data Pipelines Software Engineering Program Management Pre-silicon Workflows
10+ yrs exp

Technical Program Manager, Infrastructure

Stripe

Remote (South San Francisco, CA) 52 days ago $173,400–$260,200
AWS Microsoft Azure Oracle Cloud SQL Service Oriented Architecture Software Architecture Systems Design Cloud Infrastructure Networking Technical Program Management
5+ yrs exp Remote

Technical Program Manager, AI Research

Amd

Santa Clara, CA 10 days ago $187,120–$280,680
Reinforcement Learning LLM post training Distributed Training Machine Learning RLHF GRPO Reward Modeling ML Systems Hardware/Software Co-design EDA Benchmark Design Technical Program Management Research Program Management
Hybrid