Senior Product Manager, AI Infrastructure

Microsoft

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$119,800–$234,700 / yr
Posted
59 days ago
Freshness
Confirmed live today
Closes
Feb 24, 2027

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $202k
This role $177k
$106k $248k
below market most similar roles pay here above market

This role pays less than 75% of similar roles. Most pay $177,250–$227,050 — the blue band above. At the midpoint, this role pays about $177k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 651 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior Product Manager, AI Infrastructure

The Senior Product Manager - AI Infrastructure joins the Azure HPC & AI Infrastructure team to own the product strategy and execution for back-end networking across GPU infrastructure. This role involves translating AI training and inference workload needs into requirements for bandwidth, latency, topology, congestion management, resiliency, security, observability, and serviceability. You will drive the end-to-end product lifecycle from concept through qualification, launch, and fleet deployment. Key responsibilities include influencing supplier roadmaps for GPU systems, network interface devices, switches, optics, cables, and interconnect technologies. You must possess experience with Ethernet, InfiniBand, RDMA, and NVLink. The role solves technical challenges in building next-generation AI Factories by aligning architecture and investment choices across networking, systems engineering, software, datacenter infrastructure, operations, supply chain, and finance.

What does a Product Manager earn in Remote?

Median $206400 from 126 postings across 34 companies.

See salary data

What you'll do

  • Define the product strategy and multi-year roadmap for GPU back-end networking capabilities.
  • Translate AI training and inference workload needs into technical requirements for bandwidth, latency, and resiliency.
  • Own the end-to-end product lifecycle from initial concept through qualification, launch, and fleet deployment.
  • Influence supplier roadmaps for GPU systems, switches, optics, cables, and interconnect technologies.
  • Drive alignment across hardware, software, networking, datacenter infrastructure, and supply chain teams.
  • Establish success metrics and operating mechanisms for performance, reliability, cost efficiency, and launch health.
  • Use customer signals and telemetry to prioritize infrastructure improvements and resolve technical tradeoffs.

What we're looking for

  • Bachelor's Degree and 5+ years of experience in product/service/program management or software development, or equivalent experience.
  • 1+ years of experience with GPU or AI-accelerated hardware systems and infrastructure.
  • 1+ years of experience with datacenter networking or accelerated computing infrastructure, including Ethernet, InfiniBand, RDMA, and NVLink.
  • Ability to pass the Microsoft Cloud Background Check and other government security screenings.
  • Bachelor's Degree and 8+ years of experience in product/service/program management or software development, or equivalent experience (preferred).
  • 2+ years of experience taking a product, feature, or experience to market (preferred).
  • 4+ years of experience improving product metrics for a product, feature, or experience in a market (preferred).
  • 4+ years of experience disrupting a market for a product, feature, or experience (preferred).

More like this

Similar roles

Senior Product Manager, AI Inference Performance

Nvidia

Santa Clara, CA 5 days ago $208,000–$327,750
AI Inference TensorRT-LLM vLLM SGLang NVIDIA Dynamo Triton Inference Server Quantization KV Caching Speculative Decoding LLM Capacity Planning Autoscaling SLA Management Benchmarking
10+ yrs exp

Senior Product Manager, AI

Brex

San Francisco, CA +2 45 days ago $184,000–$230,000
AI ML Evals Agentic Software Search and Ranking Risk and Fraud Detection Prototyping
Hybrid

Senior Product Manager, AI

Brex

San Francisco, CA +2 39 days ago $184,000–$230,000
AI ML Agentic Software Evals Search and Ranking Risk and Fraud Detection Prototyping
Hybrid

Senior Product Manager, AI Engineering

Dell Technologies

Hopkinton, MA +1 19 days ago $147,000–$202,400
Generative AI Agentic AI MLOps Data Ingestion Machine Learning Full Stack Agile Data Science Software Development Multi-cloud
8+ yrs exp