This role pays more than
85%
of similar roles. Most pay
$177,250–$228,412
— the shaded band above.
At the midpoint, this role pays about
$257k
versus about
$203k
for comparable roles.
Based on 240 similar postings.
Employer
About Amd
AMD (Advanced Micro Devices) is a semiconductor company that develops high-performance processors, graphics cards, and adaptive computing solutions for gaming, data centers, and embedded markets. Industry: Semiconductors
Amd currently has
367 open roles
on FindRole.
Listed pay typically runs
$166,400–$249,600
across 367 roles with salary data.
Senior Product Manager –AI Inference Software joins the team to own the framework-layer inference product strategy for ROCm, focusing on production AI inference on AMD Instinct hardware. The role involves translating customer, ecosystem, and engineering signals into roadmap decisions to enable efficient, reliable, and competitive large-scale model deployment. Key responsibilities include defining software stack capabilities for single-GPU through rack-scale deployments, identifying emerging model architectures, and partnering with engineering teams across inference engines, serving, orchestration, memory systems, and GPU libraries. The candidate will engage with the open-source community and sophisticated AI infrastructure customers to drive technical requirements. Required expertise includes production AI inference systems, including vLLM, SGLang, AMD ATOM, and llm-d, alongside knowledge of memory management and distributed inference. This role addresses the challenge of scaling large models within a complex software ecosystem.
AI Inference
TensorRT-LLM
vLLM
SGLang
NVIDIA Dynamo
Triton Inference Server
Quantization
Speculative Decoding
KV Caching
LLM
Deep Learning
Generative AI
Benchmarking
Capacity Planning
Autoscaling