Senior System Software Engineer, Dynamo-Triton Inference Server

Nvidia

Confirmed live today Trusted

Remote

Quick summary

Work type: Remote
Location: Santa Clara, CASeattle, WA
Salary: $152,000–$241,500 / yr
Employment: Full-time
Posted: 117 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $207k

This role $197k

$141k $259k

below market most similar roles pay here above market

This role pays less than 56% of similar roles. Most pay $177,900–$235,750 — the blue band above. At the midpoint, this role pays about $197k versus about $207k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior System Software Engineer, Dynamo-Triton Inference Server

Role Posting Log in to save

As a Senior System Software Engineer on the Dynamo-Triton Inference Server team, you will develop world-class GPU-accelerated AI inference serving software. Your primary responsibility involves driving the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to create a unified, high-performance platform. You will build robust software for production server and cloud environments, ensuring feature parity for both Large Language Model and non-LLM workloads while optimizing prediction throughput and latency. The role requires expert proficiency in Rust and C++, familiarity with Python, and strong skills in debugging, performance analysis, and test design. You will work on high-scale distributed systems and ML systems, potentially utilizing frameworks like TensorRT, PyTorch, ONNX, vLLM, or TRT-LLM to solve complex inference deployment problems.

What does a System Software Engineer earn in California?

Median $235750 from 70 postings across 4 companies.

See salary data

Skills

Rust C++ Python Triton Inference Server TensorRT PyTorch ONNX OpenVINO vLLM TRT-LLM Distributed Systems ML Systems GitHub Performance Analysis

What you'll do

Develop world-class GPU-accelerated AI inference serving software.
Drive the convergence of Triton Inference Server and NVIDIA Dynamo stacks into a unified platform.
Ensure feature parity and performance for both Large Language Model and non-LLM workloads.
Build robust software designed for production server and cloud environments.
Optimize and balance prediction throughput and latency for inference tasks.
Develop and adopt next-generation inference technologies.
Contribute to the open source deep learning software engineering community.

What we're looking for

MS or PhD in Computer Science or a relevant field, or equivalent experience.
5+ years of professional experience working on deep learning software.
Excellent Rust and C++ skills with familiarity with Python.
Strong programming and software design skills including debugging, performance analysis, and test design.
Experience with high-scale distributed systems and ML systems.
Strong communication skills and the ability to work in a fast-paced, agile team environment.
Prior experience with AI frameworks and engines such as TensorRT, PyTorch, ONNX, OpenVINO, vLLM, or TRT-LLM (preferred).
Knowledge of GPU memory management, cache management, high-performance networking, or contributing to large open source projects (preferred).