Software Engineering Intern

Nvidia

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Santa Clara, CA
Employment: Full-time
Posted: 83 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $158k

$104k $211k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $114,400–$200,900.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Software Engineering Intern

Role Posting Log in to save

JOB TITLE: Software Engineering Intern, Dynamo - Fall 2026 As a Software Engineering Intern, Dynamo - Fall 2026, you will join the Dynamo team to build an open-source platform for efficient, scalable inference for large language and reasoning models in distributed GPU environments. You will design and develop the Dynamo Kubernetes stack, introduce features to the Python SDK and Rust Runtime Core Library, and optimize distributed inference components. Your daily work involves developing disaggregated serving for engines like vLLM and SGLang, improving intelligent routing, and managing distributed KV caches. You must possess strong programming skills in Golang, Rust, and Python, along with knowledge of algorithms, data structures, and RESTful APIs. This role addresses critical challenges in distributed AI infrastructure, specifically focusing on GPU resource management and high-performance serving architectures for demanding applications.

Skills

Python Rust Golang Kubernetes vLLM SGLang TensorRT-LLM llama.cpp mistral.rs RESTful APIs Data Structures Algorithms open-source NLP Machine Learning

What you'll do

Design and develop the Dynamo Kubernetes stack.
Implement and optimize distributed inference components using Rust and Python.
Develop disaggregated serving for inference engines like vLLM and SGLang.
Improve intelligent routing and KV-cache management subsystems.
Contribute to open-source repositories and participate in code reviews.
Perform issue triage on GitHub and address community feedback.
Evolve the framework’s APIs and overall architecture.

What we're looking for

Pursuing a BS, MS, or PhD in Computer Science or an equivalent program area.
Excellent programming and software design skills in Golang, Rust, and/or Python.
Proficiency in debugging, performance analysis, service health analysis, and test design.
Good understanding of algorithms, data structures, and solid knowledge of RESTful APIs.
Understanding of machine learning or NLP concepts (preferred).
Experience in software shipping cycles (dev, deploy, release, CI) and open-source software development (preferred).
Experience working with inference engines such as vLLM, SGLang, TensorRT-LLM, and similar (preferred).
Experience building and deploying containers in Kubernetes environments (preferred).

Similar roles

Software Developer Intern

IBM

Cambridge 29 days ago

Python Go Java JavaScript TypeScript C++ Rust Docker Kubernetes REST APIs Git CI/CD LangChain LangGraph LlamaIndex IBM Cloud AWS Azure GCP OpenTelemetry NoSQL

Save

PhD Software Engineering Intern, Decision Intelligence

Nvidia

Santa Clara, CA 158 days ago

C++ CUDA Python Parallel Computing Operations Research Optimization Machine Learning GPU Programming Numerical Methods Genetic Algorithms Large Neighborhood Search Performance Tuning Benchmarking

Save