High-Performance LLM Training Engineer

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$124,000–$195,500 / yr
Employment
Full-time
Posted
6 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $203k
This role $160k
$108k $276k
below market most similar roles pay here above market

This role pays less than 66% of similar roles. Most pay $152,737–$253,500 — the blue band above. At the midpoint, this role pays about $160k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · High-Performance LLM Training Engineer

NVIDIA is seeking a High-Performance LLM Training Engineer - New College Grad 2027 to join the team focused on optimizing high-performance LLM software stacks. The role involves understanding, analyzing, profiling, and optimizing AI training workloads on innovative hardware and software platforms. You will implement production-quality software across multiple layers of the deep learning platform stack, specifically for high-performance pre-training and post-training on thousands of GPUs. Key responsibilities include implementing LLM training workloads in proprietary processor and system simulators and building agentic tools to automate workload analysis. Required skills include proficiency in C++, Python, and CUDA, along with a background in deep learning, neural networks, and computer architecture. The work addresses the technical challenge of improving training efficiency for state-of-the-art LLMs.

What you'll do

  • Analyze and profile AI training workloads on innovative hardware and software platforms.
  • Optimize high-performance LLM training workloads across thousands of GPUs.
  • Implement production-quality software across multiple layers of the deep learning platform stack.
  • Execute key LLM training workloads in proprietary processor and system simulators.
  • Build agentic tools to automate workload analysis and optimization workflows.
  • Solve performance problems for state-of-the-art large language models.
  • Provide input to shape hardware roadmaps for next-generation GPUs.

What we're looking for

  • M.S. or PhD in Computer Science, Electrical Engineering, or Computer Engineering (or equivalent experience).
  • Strong background in deep learning and neural networks, specifically model training optimizations.
  • Deep background in computer architecture and familiarity with the fundamentals of GPU architecture.
  • Proven experience analyzing and tuning application performance and processor/system-level performance modeling.
  • Programming skills in C++, Python, and CUDA.
  • Experience optimizing LLM training workloads in frameworks like PyTorch and JAX.

More like this

Similar roles

Deep Learning Software Engineer, TensorRT Performance

Nvidia

Remote (Santa Clara, CA) 15 days ago
TensorRT PyTorch C++ Python CUDA Triton JAX TensorFlow ONNX vLLM SGLang FlashInfer TorchDynamo TorchInductor Quantization Graph Compilers Distributed Inference TileIR CuTeDSL Cutlass
2+ yrs exp Remote

Senior AI Training Performance Architect

Nvidia

Santa Clara, CA 95 days ago $184,000–$287,500
CUDA C++ Python GPU Architecture Deep Learning Neural Networks Performance Modeling MLPerf Training Computer Architecture System Simulators Performance Analysis Drivers DL Frameworks
5+ yrs exp

Performance Engineer, Deep Learning

Nvidia

Santa Clara, CA 22 days ago
C++ Python PyTorch JAX CUDA OpenAI Triton cuBLAS cuDNN cuSOLVER Parallel Systems Deep Learning LLMs Computer Architecture Code Optimization Operating Systems MLPerf Transformer Engine

Senior Performance Engineer, Deep Learning

Nvidia

Santa Clara, CA 74 days ago
C++ Python PyTorch JAX CUDA OpenAI Triton cuBLAS cuDNN cuSOLVER Parallel Systems Deep Learning LLMs Transformer Engine MLPerf Code Optimization Computer Architecture Operating Systems

University Graduate Machine Learning Engineer

Adobe

San Jose, CA +6 33 days ago $102,400–$202,250
Machine Learning Deep Learning Python Scala Java C SQL R Matlab scikit learn Statistical Modeling Data Mining Big Data Relational Databases Time Series Analysis Causal Analysis