Senior Product Manager, AI Infrastructure

Microsoft

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Salary
$119,800–$234,700 / yr
Posted
14 days ago
Freshness
Confirmed live 2 days ago
Closes
Feb 24, 2027

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $214k
This role $177k
$105k most similar roles pay here $258k

This role pays less than 80% of similar roles. Most pay $185,375–$243,525 — the shaded band above. At the midpoint, this role pays about $177k versus about $214k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 598 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 586 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior Product Manager, AI Infrastructure

As a Senior Product Manager - AI Infrastructure on the Azure HPC & AI Infrastructure team, you will own the product strategy and execution for back-end networking across GPU infrastructure. You will translate complex training and inference workload needs into specific requirements for bandwidth, latency, topology, congestion management, resiliency, security, observability, and serviceability. Your daily work involves managing the end-to-end product lifecycle from concept through qualification, launch, and fleet deployment while aligning hardware, software engineering, datacenter infrastructure, supply chain, and finance teams. You will influence supplier roadmaps for network interface devices, switches, optics, cables, and interconnect technologies like Ethernet, InfiniBand, RDMA, and NVLink. This role solves critical technical challenges in building the next generation of AI Factories by improving performance, reliability, and total cost of ownership for large-scale AI training and inference systems.

What does a Product Manager earn?

Median $204200 from 424 postings across 77 companies.

See salary data

What you'll do

  • Define the product strategy and multi-year roadmap for GPU back-end networking capabilities.
  • Translate AI training and inference workload needs into technical requirements for bandwidth, latency, and reliability.
  • Manage the end-to-end product lifecycle from initial concept through qualification, launch, and fleet deployment.
  • Influence supplier roadmaps and product definitions for switches, optics, cables, and interconnect technologies.
  • Drive cross-functional alignment across engineering, supply chain, finance, and datacenter operations teams.
  • Establish success metrics and operating mechanisms for performance, cost efficiency, and deployment readiness.
  • Resolve technical and business tradeoffs to improve platform outcomes and total cost of ownership.

What we're looking for

  • Bachelor's Degree and 5+ years of experience in product/service/program management or software development (or equivalent).
  • 1+ years of experience with GPU or AI-accelerated hardware systems and infrastructure.
  • 1+ years of experience with datacenter networking or accelerated computing infrastructure, including Ethernet, InfiniBand, RDMA, and NVLink.
  • Ability to pass the Microsoft Cloud Background Check every two years.
  • Preferred: Bachelor's Degree and 8+ years of experience in product/service/program management or software development (or equivalent).
  • Preferred: 2+ years of experience taking a product, feature, or experience to market.
  • Preferred: 4+ years of experience improving product metrics for a product, feature, or experience in a market.
  • Preferred: 4+ years of experience disrupting a market for a product, feature, or experience.

More like this

Similar roles

Senior Product Manager, AI Inference Performance

Nvidia

Santa Clara, CA 30 days ago $208,000$327,750
AI Inference TensorRT-LLM vLLM SGLang NVIDIA Dynamo Triton Inference Server Quantization Speculative Decoding KV Caching LLM Deep Learning Generative AI Benchmarking Capacity Planning Autoscaling
10+ yrs exp