Principal Technical Product Manager, Accelerator Optimization

Microsoft

Quick summary

Work type: On-site
Location: —
Salary: $165,600–$296,400 / yr
Posted: 29 days ago
Closes: Nov 25, 2026

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $200k

This role $231k

$141k most similar roles pay here $313k

This role pays more than 76% of similar roles. Most pay $170,000–$230,750 — the shaded band above. At the midpoint, this role pays about $231k versus about $200k for comparable roles.

Based on 238 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 636 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Technical Product Manager, Accelerator Optimization

Role Posting Log in to save

Microsoft seeks a Principal Product Manager to lead the AMD inference platform optimization strategy for Azure AI services. This senior role involves defining and executing a clear product roadmap that enhances performance, correctness, stability, and compatibility of advanced AI models on AMD GPUs. The candidate will collaborate with engineering teams across various domains to prioritize work, make technical decisions, and ensure production standards are met. Key responsibilities include driving release readiness, improving platform performance through data analysis, and partnering with external vendors like AMD for product delivery. Ideal candidates have extensive experience in AI/ML infrastructure, GPU systems, and cloud platforms, along with a deep understanding of AMD or NVIDIA ecosystems and proven ability to influence across organizational boundaries.

Skills

AMD NVIDIA GPU AI ML Distributed Systems Model Serving Compilers Runtime Systems Performance Engineering Cloud Platform Architecture CI/CD Benchmarking Regression Detection Service Reliability Python C++ CUDA OpenCL Kubernetes Terraform

What you'll do

Define and drive the AMD GPU platform optimization strategy for Azure AI services.
Prioritize engineering work across performance optimization, correctness, compatibility, stability, and release quality.
Own technical product decisions on throughput, latency, scalability, memory behavior, reliability, and cost efficiency.
Ensure AMD implementations meet production standards for performance and operational quality by tracking KPIs.
Drive release readiness through planning, validation, regression prevention, deployment, and production handoff.
Use data from benchmarking, testing, and incident trends to improve platform performance and predictability.

What we're looking for

At least 8 years of experience managing cross-functional projects.
Technical expertise in AI/ML infrastructure, GPU systems, or cloud platform architecture.
Proven ability to influence across organizational boundaries and drive clarity in complex environments.
Familiarity with AMD or NVIDIA GPU ecosystems and model execution frameworks.
Experience working with external ecosystem partners on technical product delivery.
Track record of improving release readiness and service reliability processes.
1+ year of experience reading or writing code for technical documentation.

Similar roles

Senior Technical Product Manager, Accelerated Computing

Nvidia

Santa Clara, CA 31 days ago $168,000–$258,750

GPU AI Machine Learning High-Performance Computing Large Language Models Cloud Computing Infrastructure Product Management Sales Collateral Engineering Operations Kubernetes Docker CI/CD Python PostgreSQL AWS Azure Grafana Prometheus

Save

Principal Technical Product Manager

The Hartford

Hartford, CT 12 days ago $153,200–$229,800

MachineLearning DataScience AI GenerativeAI CloudComputing GCP AWS Azure CI/CD AgileMethodology Python R SQL PostgreSQL Kubernetes Terraform Docker Prometheus Grafana SOX GDPR HIPAA ModelRiskManagement DataPrivacy Security Auditability EnterpriseRiskManagement

Save

Hardware Engineering Technical Leader

Cisco

Remote (San Jose, CA) 6 days ago $168,800–$241,200

PCB Signal Integrity (SI) Tolerance Analysis Materials Selection Plating Validation Testing Mechanical Engineering Electrical Design Thermal Management Liquid Cooling Coolant Cables Cold-Plate Leak Detection Thermal Interface Materials (TIM) Active Cooling Connectors SPC FMEA 8D/Corrective Action Cause-and-Effect Analysis Design of Experiments (DOE) Risk Assessment

Remote

Save

Technical Product Manager

Broadcom

Palo Alto, CA 72 days ago $120,000–$192,000

Terraform Python Ansible VCDX CCIE (Security) CI/CD VMware VCF Docker Kubernetes PostgreSQL Git Swagger RESTful APIs JSON YAML Prometheus Grafana Linux Windows Server

Save

Technical Product Manager

Applied Materials

Austin, TX +1 37 days ago $132,000–$181,500

Python FastAPI Polars SQLAlchemy React HTML CSS JavaScript REST JSON XML SQL CI/CD Docker RabbitMQ SQS AMQP PostgreSQL

Save

Technical Product Manager

Electronic Arts

Madrid, Spain 24 days ago

Agile Scrum Kanban Project Management Business Analysis CRM Software Engineering English AI Cloud Services Docker CI/CD Python PostgreSQL

Hybrid

Save