below marketmost similar roles pay hereabove market
This role pays more than
99%
of similar roles. Most pay
$194,500–$267,562
— the blue band above.
At the midpoint, this role pays about
$404k
versus about
$231k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
1623 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 1110 roles with salary data.
The Distinguished Engineer, Scaled Out Inferencing joins the team to lead the global strategy for scaled-out AI inferencing. This role involves architecting high-throughput, low-latency distributed pipelines and model serving strategies for massive-scale production reliability. You will define the technical roadmap for full-lifecycle model management, including automated deployment, versioning, and intelligent scaling across cloud and datacenter environments. Key responsibilities include hardware-software co-optimization, performance tuning at the kernel and driver level, and optimizing GPU resource management. You will utilize technologies such as CUDA, kernels, and cloud-native architectures for multi-tenant model serving. Additionally, you will guide open source projects including Dynamo, TensorRT-LLM, vLLM, SGLang, Linux, Kubernetes, and Ray to enable advanced AI models to run with peak efficiency on accelerated computing hardware.
What does a Engineer earn in California?
Median $199500 from 103 postings across 31 companies.
AWS
Microsoft Azure
Google Cloud
Java
Python
Go
JavaScript
TypeScript
Swift
Machine Learning
Platform Engineering
Enterprise Architecture
Observability
Cloud Computing