Principal Technical Product Manager- Accelerator Optimization | Microsoft Careers
At a glance
AI generatedTL;DR
As a Principal Product Manager at Microsoft, you will lead the AMD inference platform optimization strategy for Azure AI services, ensuring advanced AI models run efficiently on AMD GPUs. This senior individual contributor role involves defining and executing product strategies in collaboration with engineering teams to enhance performance, stability, and compatibility across various hardware generations. You will own technical decisions impacting throughput, latency, scalability, and cost efficiency while driving release readiness and improving operational quality metrics. The ideal candidate has extensive experience in AI/ML infrastructure, GPU systems, and cloud platform architecture, along with a deep understanding of AMD and NVIDIA GPU ecosystems. This role demands strong cross-functional collaboration skills to resolve production issues and drive long-term systemic improvements, ensuring the platform scales efficiently at global scale.
Skills
What you'll do
- Define and drive AMD GPU platform optimization strategy for AI models.
- Prioritize engineering work to enhance performance, correctness, and stability on AMD GPUs.
- Make technical product decisions impacting throughput, latency, scalability, and reliability.
- Ensure AMD implementations meet production standards with measurable KPI improvements.
- Drive release readiness and deployment of AMD platforms across the lifecycle.
What we're looking for
- At least 12 years of experience in engineering, product management, data analysis, or product development.
- Deep technical expertise in AI/ML infrastructure, GPU systems, distributed systems, model serving, compilers, runtime systems, performance engineering, or cloud platform architecture.
- Proven ability to influence across organizational boundaries and drive clarity in complex environments.
- Familiarity with AMD and/or NVIDIA GPU ecosystems, model execution frameworks, compiler/runtime stacks, or hardware/software co-optimization.
- Experience managing cross-functional projects involving external ecosystem partners, silicon vendors, or platform partners.
- Track record of improving release readiness, continuous integration quality, benchmarking, regression detection, or service reliability processes.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has 534 open roles on FindRole.
Listed pay typically runs $119,800–$234,700 across 488 roles with salary data.
Most-posted roles
- | Microsoft Careers 121
- Principal Software Engineer | Microsoft Careers 19
- Senior Software Engineer | Microsoft Careers 18
- Software Engineer II | Microsoft Careers 10
- Principal Applied Scientist | Microsoft Careers 5