This role pays less than
53%
of similar roles. Most pay
$196,750–$270,500
— the shaded band above.
At the midpoint, this role pays about
$236k
versus about
$234k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
896 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 876 roles with salary data.
Engineering Manager, Deep Learning Inference will lead a high-performing engineering team focused on deep learning inference and GPU-accelerated software. This role involves driving the strategy, roadmap, and execution of inference frameworks for Client AI while partnering with internal compiler, library, and research teams to deliver optimized pipelines across NVIDIA accelerators. The manager will oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications. Key technical requirements include proficiency in C/C++, Python, and GPU programming using CUDA, Triton, and CUTLASS. Candidates must also possess expertise in multi-GPU communications via NIXL, NCCL, and NVSHMEM. The role addresses the critical challenge of making AI deployment scalable and efficient by optimizing open-source frameworks like vLLM, SGLang, and FlashInfer to enable real-time inference across datacenter clusters and edge devices.
What does a Engineering Manager earn in California?
Median $290250 from 64 postings across 19 companies.
CUDA
Python
C++
Rust
TensorRT-LLM
vLLM
SGLang
Triton
PyTorch
NVIDIA Nsight Systems
CUTLASS
NCCL
Quantization
Distributed Systems
GPU Architecture
Model Parallelism
Speculative Decoding