This role pays more than
89%
of similar roles. Most pay
$151,000–$219,562
— the shaded band above.
At the midpoint, this role pays about
$236k
versus about
$185k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
896 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 876 roles with salary data.
As a Senior Software Engineer, AI Inference Systems, you will join a specialized team to build high-performance inference stacks and optimize GPU kernels for large-scale models. Your daily responsibilities include contributing features to vLLM, implementing speculative decoding, and developing high-level DSLs and compiler infrastructure to improve kernel developer productivity. You will also design benchmarking methodologies, manage containerized deployments across multi-cloud environments, and conduct original research in ML Systems. The role requires proficiency in Python, C/C++, and familiarity with Go or Rust. Key technical requirements include experience with CUDA, PyTorch, vLLM, SGLang, and tools like Nsight Systems. You will work on solving complex problems in accelerated computing by optimizing memory layouts, utilizing Triton or MLIR, and managing large-scale inference deployments across distributed GPU clusters to push the frontier of efficient AI performance.
What does a Software Engineer earn in California?
Median $214000 from 775 postings across 63 companies.
CUDA
Python
C++
Rust
TensorRT-LLM
vLLM
SGLang
Triton
PyTorch
NVIDIA Nsight Systems
CUTLASS
NCCL
Quantization
Distributed Systems
GPU Architecture
Model Parallelism
Speculative Decoding