Senior System Software Engineer - Dynamo-Triton Inference Server

Nvidia

Remote Actively hiring

Remote · Santa Clara, CA · Seattle, WA Posted 32 days ago $152,000–$241,500 / year

View original post Log in to save

At a glance

AI generated

TL;DR

As a Senior System Software Engineer on NVIDIA’s GPU-accelerated deep learning team, you will develop high-performance AI inference software for GPUs, focusing on feature development to drive broad customer adoption. Your day-to-day tasks include integrating the Triton Inference Server and Dynamo stacks to create a unified platform that supports both Large Language Models and other workloads efficiently. You will contribute to open-source projects, ensuring robustness in production environments while optimizing prediction throughput and latency. Ideal candidates have advanced degrees or equivalent experience in Computer Science, with expertise in Rust and C++, along with familiarity in Python. Strong skills in high-scale distributed systems, ML frameworks like TensorRT and PyTorch, GPU memory management, and open-source project contributions are essential for this fast-paced role.

Skills

Rust C++ Python TensorRT PyTorch ONNX OpenVINO vLLM TRT-LLM GPU Distributed Systems GitHub CI/CD Kubernetes Prometheus Grafana NVIDIA Triton Inference Server

What you'll do

Develop GPU-accelerated AI inference serving software for high performance.
Contribute to feature development to drive broad customer adoption of Triton Inference Server.
Integrate NVIDIA Dynamo stack with Triton Inference Server for unified platform support.
Optimize prediction throughput and latency in production server environments.
Design robust software solutions for deploying new AI models efficiently.

What we're looking for

MS or PhD in Computer Science or relevant field with 5+ years of deep learning software experience.
Expertise in Rust, C++, Python, and strong programming & design skills including debugging and performance analysis.
Experience with high-scale distributed systems, ML systems, and AI frameworks like TensorRT, PyTorch, ONNX.
Strong communication skills and ability to work effectively in a fast-paced, agile team environment.
Knowledge of GPU memory management, cache management, and high-performance networking.

Market check

Salary context

This $152,000–$241,500 range sits above 75% of similar postings on FindRole.

Peer median band

$119,782–$211,000

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$139,100–$197,062

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

Similar roles

Senior, Software Engineer

Walmart

(Usa) Crossman Respect Building Ca Sunnyvale Home Office, US 43 days ago $117,000–$234,000

TypeScript JavaScript React Webpack GraphQL Apollo_Client Relay Nx Lerna HTML CSS Vite Performance_Optimization Frontend_Performance Browser_Storage Memory_Caching Code_Quality CI/CD GenAI Agentic_Workflows

Senior, Software Engineer

Walmart

(Usa) Bentonville Global Tech Ar Bentonville Home Office, US 37 days ago $90,000–$180,000

Java Kotlin TypeScript Python CI/CD AI/ML GenAI Cassandra Kafka Apache Spark GCP AWS PostgreSQL Docker Kubernetes

Senior, Software Engineer

Walmart

(Usa) Crossman Excellence Building Ca Sunnyvale Home Office, US 44 days ago $90,000–$180,000

Python Java Kafka Docker CI/CD Microservices APIs Video Streaming Real-time Analytics Machine Learning Image Processing PostgreSQL Redis AWS Kubernetes Terraform Git Jenkins

Senior, Software Engineer

Walmart

(Usa) Sunnyvale Tech Corners Bldg 6 Ca Sunnyvale Home Office, US 37 days ago $117,000–$234,000

Swift UIKit SwiftUI Xcode GraphQL REST Combine Core Data Dependency Injection iOS frameworks multithreading networking offline storage performance optimization Agile development

Senior, Software Engineer

Walmart

(Usa) Crossman Respect Building Ca Sunnyvale Home Office, US 9 days ago

Java Rust NodeJS GraphQL Apollo Federation Framework React TypeScript Kubernetes Docker CI/CD Prometheus Grafana AWS Azure Google Cloud Platform PostgreSQL MongoDB Redis Git Jenkins Terraform Kafka

Senior, Software Engineer

Walmart

(Usa) David Glass Technology Center Property Costs Ar Bentonville Home Office, US 45 days ago $90,000–$180,000

Java Spring Spring Boot Docker Kubernetes Maven JUnit Mockito Git GitHub Azure Google Cloud Platform PostgreSQL MongoDB Wireshark Charles Splunk Apache Kafka Confluence