This role pays more than
57%
of similar roles. Most pay
$185,375–$231,187
— the shaded band above.
At the midpoint, this role pays about
$213k
versus about
$208k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
896 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 876 roles with salary data.
As a Senior Product Manager - AI Platform Inference, you will join the Product Management team to build tools, SDKs, and libraries that enable developers to successfully deploy inference models on NVIDIA GPUs. You will be responsible for creating products to improve deployment quality, developing product strategies, establishing roadmaps, and crafting go-to-market plans. Your daily work involves collaborating with internal and external developers to build roadmaps specifically for model optimization software while aligning with leadership to drive company strategy. The role requires expertise in inference deployment and optimization software such as vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, and TorchAO. You must possess deep knowledge of Generative AI, machine learning performance optimization, GPU architecture, hardware/software co-design, and performance profiling to solve complex challenges in the rapidly evolving inference landscape.
What does a Product Manager earn in California?
Median $223300 from 163 postings across 44 companies.
AI Inference
TensorRT-LLM
vLLM
SGLang
NVIDIA Dynamo
Triton Inference Server
Quantization
Speculative Decoding
KV Caching
LLM
Deep Learning
Generative AI
Benchmarking
Capacity Planning
Autoscaling
CUDA
Python
C++
Rust
TensorRT-LLM
vLLM
SGLang
Triton
PyTorch
NVIDIA Nsight Systems
CUTLASS
NCCL
Quantization
Distributed Systems
GPU Architecture
Model Parallelism
Speculative Decoding