This listing doesn't post a salary. Most similar roles pay
$126,312–$201,825.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
896 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 876 roles with salary data.
Software Engineering Intern, Dynamo - Fall 2026 will join the team developing an open-source platform for efficient, scalable inference of large language and reasoning models in distributed GPU environments. This role focuses on solving complex problems in distributed AI infrastructure, specifically involving the Dynamo Kubernetes serving platform, disaggregated serving, dynamic GPU scheduling, intelligent routing, and distributed KV cache management. You will design and optimize components using Rust and Python, contribute to the Python SDK and Rust Runtime Core Library, and support inference engines like vLLM, SGLang, TRT-LLM, and llama.cpp. The role requires proficiency in Golang, Rust, or Python, along with strong skills in data structures, algorithms, and RESTful APIs. You will also engage in open-source development, including code reviews, issue triage on GitHub, and evolving framework architectures to improve high-performance AI inference for demanding applications.
C++
CUDA
Python
Optimization
Operations Research
Heuristics
Genetic Algorithms
Large Neighborhood Search
Machine Learning
GPU Programming
Performance Tuning
Benchmarking