Senior System Software Engineer, Agentic Inference
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays less than 54% of similar roles. Most pay $155,675–$235,750 — the shaded band above. At the midpoint, this role pays about $197k versus about $196k for comparable roles.
Based on 240 similar postings.
Employer
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has 896 open roles on FindRole.
Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.
Most-posted roles
At a glance
As a Senior System Software Engineer on the GPU-accelerated deep learning software team, you will develop world-class inference serving software for the Dynamo-Triton Inference Server. You will contribute to feature development and drive the convergence of Triton and NVIDIA Dynamo stacks to create a unified platform supporting both Large Language Model and non-LLM workloads. Your daily responsibilities include building robust software for production server or cloud environments, optimizing prediction throughput and latency, and adopting next-generation inference technologies while participating in the open source community. The role requires expert skills in Rust and C++, familiarity with Python, and experience in high-scale distributed systems and machine learning systems. You will utilize tools like TensorRT, PyTorch, ONNX, vLLM, or TRT-LLM to solve complex problems involving GPU memory management, cache management, and high-performance networking for AI model deployment.
What does a System Software Engineer earn in California?
Median $235750 from 37 postings across 4 companies.
Skills
What you'll do
What we're looking for
More like this
Nvidia
Nvidia
Nvidia
Nvidia
Nvidia
Nvidia