This role pays more than
89%
of similar roles. Most pay
$182,621–$243,600
— the shaded band above.
At the midpoint, this role pays about
$268k
versus about
$213k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
1150 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 912 roles with salary data.
As a Senior Product Manager, Inference Platform, you will join the team building foundations for serving AI workloads at scale for internal employees and DSX Partners. You will define product vision and strategy for inference platform capabilities, including APIs, capacity management, cost management, performance optimization, and model serving infrastructure. Your daily work involves translating user needs into prioritized roadmaps, managing the end-to-end product lifecycle, and navigating ambiguous problem spaces to deliver reliable, efficient large-scale model serving. You will utilize expertise in AI/ML systems and inference serving frameworks like TensorRT-LLM, vLLM, or Triton Inference Server. The role requires deep knowledge of model formats, token economics, and advanced techniques such as speculative decoding and KV cache management. You will solve complex problems regarding hardware efficiency, developer experience, and infrastructure constraints for both open source and proprietary models.
What does a Product Manager earn in California?
Median $221750 from 204 postings across 45 companies.
AI Inference
TensorRT-LLM
vLLM
SGLang
NVIDIA Dynamo
Triton Inference Server
Quantization
Speculative Decoding
KV Caching
LLM
Deep Learning
Generative AI
Benchmarking
Capacity Planning
Autoscaling