Senior Software Engineer, AI Inference Systems
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays more than 72% of similar roles. Most pay $151,000–$212,950 — the shaded band above. At the midpoint, this role pays about $197k versus about $182k for comparable roles.
Based on 240 similar postings.
Employer
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has 896 open roles on FindRole.
Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.
Most-posted roles
At a glance
As a Senior Software Engineer - Scientific Evaluation, you will own the architecture and roadmap for a shared platform dedicated to classical testing, scientific benchmarking, and agentic evaluation. You will design and implement infrastructure, benchmarks, and test levels for scientific agents and software while establishing trusted references, numerical tolerances, and calibrated scorers for nondeterministic workloads. This role involves managing heterogeneous GPU capacity using tools like Slurm, Kubernetes, Docker, and CMake to ensure reproducible quality signals across CUDA and C++ libraries, Python packages, and PyTorch integrations. You will solve complex problems regarding measurement practices, variance, and regression detection in distributed systems. Required skills include production-level C++, Python, Linux, and Git. The work focuses on the technical challenge of creating reliable evaluation gates for scientific models and AI agents within large GPU fleets.
What does a Software Engineer earn in California?
Median $214000 from 775 postings across 63 companies.
Skills
What you'll do
What we're looking for
More like this
Nvidia
The Walt Disney Company
Microsoft
Datadog
Adobe