Senior High-Performance LLM Training Engineer

Nvidia

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Santa Clara, CA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
2 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $210k
This role $236k
$152k $302k
below market most similar roles pay here above market

This role pays more than 68% of similar roles. Most pay $174,081–$246,150 — the blue band above. At the midpoint, this role pays about $236k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1655 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1061 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior High-Performance LLM Training Engineer

The Senior High-Performance LLM Training Engineer joins the team to improve the efficiency of large language model training workloads. This role focuses on optimizing the high-performance software stack for training on thousands of GPUs while helping shape hardware roadmaps for next-generation processors. Key responsibilities include analyzing, profiling, and optimizing AI training workloads, implementing production-quality software across the deep learning platform stack, and building tools to automate workload analysis. The engineer will also support MLPerf Training benchmark submissions and implement workloads in proprietary processor and system simulators. Required technical skills include proficiency in C++, Python, and CUDA, alongside a deep background in computer architecture, neural networks, and GPU architecture. The work involves solving performance problems across state-of-the-art neural networks within frameworks like PyTorch and JAX.

What you'll do

  • Analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
  • Implement production-quality software across multiple layers of the deep learning platform stack.
  • Build and support NVIDIA submissions to the MLPerf Training benchmark suite.
  • Implement key deep learning training workloads in proprietary processor and system simulators.
  • Build tools to automate workload analysis, optimization, and other critical workflows.
  • Optimize high-performance LLM software stacks in frameworks like PyTorch and JAX.
  • Provide performance analysis and tuning for application, processor, and system-level performance.

What we're looking for

  • PhD in Computer Science, Electrical Engineering, or Computer Engineering with 5+ years of experience.
  • MS or equivalent experience with 8+ years of meaningful work experience.
  • Strong background in deep learning and neural networks, specifically regarding training.
  • Deep background in computer architecture and familiarity with GPU architecture fundamentals.
  • Proven experience analyzing and tuning application performance and processor/system-level performance modeling.
  • Programming skills in C++, Python, and CUDA.
  • Experience optimizing LLM training workloads in frameworks like PyTorch and JAX.

More like this

Similar roles

High-Performance LLM Training Engineer

Nvidia

Santa Clara, CA 9 days ago
PyTorch JAX CUDA Python C++ GPU Architecture Deep Learning Neural Networks Performance Analysis Performance Modeling LLM Training Computer Architecture Simulators

Senior AI Training Performance Architect

Nvidia

Santa Clara, CA 98 days ago $184,000–$287,500
CUDA C++ Python GPU Architecture Deep Learning Neural Networks Performance Modeling MLPerf Training Computer Architecture System Simulators Performance Analysis Drivers DL Frameworks
5+ yrs exp

Senior Performance Engineer, Deep Learning

Nvidia

Santa Clara, CA 77 days ago
C++ Python PyTorch JAX CUDA OpenAI Triton cuBLAS cuDNN cuSOLVER Parallel Systems Deep Learning LLMs Transformer Engine MLPerf Code Optimization Computer Architecture Operating Systems

Performance Engineer, Deep Learning

Nvidia

Santa Clara, CA 25 days ago
C++ Python PyTorch JAX CUDA OpenAI Triton cuBLAS cuDNN cuSOLVER Parallel Systems Deep Learning LLMs Computer Architecture Code Optimization Operating Systems MLPerf Transformer Engine

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 65 days ago
LLM PyTorch Huggingface AWS VectorDB Nemo Guardrails Python Go Scala Java C++ C# Google Cloud Azure Similarity Search Reinforcement Learning Model Evaluation Observability
6+ yrs exp

Senior Staff LLM Serving Engineer

Qualcomm

San Diego, CA +1 43 days ago $162,000–$243,000
LLM Serving PyTorch Python Triton-Inference Server vLLM SGLang CUDA Triton torch.compile torchDynamo Distributed Systems Deep Learning Model Optimization KV-Cache Management Inference Acceleration KServe Ollama LMCache MoonCake
4+ yrs exp