This role pays more than
94%
of similar roles. Most pay
$177,250–$227,750
— the shaded band above.
At the midpoint, this role pays about
$268k
versus about
$202k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
896 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 876 roles with salary data.
Senior Product Manager – AI Inference Performance joins the Product Management team to own the inference performance roadmap and drive the company’s Deep Learning and Generative AI strategy. This role involves managing the entire inference stack, including optimization techniques, frameworks, and benchmarking tools to improve latency, efficiency, and cost per token for various deployment scales. The candidate will define strategies for agentic applications, manage framework integrations like TensorRT-LLM, vLLM, SGLang, and NVIDIA Dynamo, and oversee performance metrics such as TTFT and throughput. Key technical requirements include expertise in KV caching, quantization, speculative decoding, and disaggregated serving. The role requires translating low-level capabilities into business value while managing release readiness and quality bars. This position focuses on the technical challenge of optimizing AI models and applications running on NVIDIA hardware across diverse customer environments.
What does a Product Manager earn in California?
Median $223300 from 163 postings across 44 companies.