Senior Product Manager, AI Platform Inference
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays more than 89% of similar roles. Most pay $177,250–$224,500 — the blue band above. At the midpoint, this role pays about $257k versus about $201k for comparable roles.
Based on 240 similar postings.
Employer
AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors
Amd currently has 496 open roles on FindRole.
Listed pay typically runs $172,000–$258,000 across 496 roles with salary data.
Most-posted roles
At a glance
The Senior Product Manager –AI Inference Software owns the framework-layer inference product strategy for ROCm. Working within the software ecosystem team, this role translates customer and engineering signals into roadmap decisions for production AI inference on AMD Instinct hardware. You will define how the framework-layer software stack enables production workloads from single-GPU to rack-scale deployments, focusing on performance, developer experience, and portability. Key responsibilities include partnering with engineering teams on inference engines, serving, orchestration, memory systems, and GPU libraries to identify performance bottlenecks. You will engage with the open-source community and sophisticated AI infrastructure customers to align technical requirements. Required expertise includes production AI inference systems like vLLM, SGLang, and AMD ATOM, along with serving systems like llm-d, distributed inference, and GPU computing.
What does a Product Manager earn in California?
Median $222500 from 327 postings across 57 companies.
Skills
What you'll do
What we're looking for
More like this
Nvidia
Nvidia
Nvidia
Nvidia
Brex
Brex