High-Performance LLM Training Engineer - New College Grad 2026

Nvidia

Actively hiring
Us, Ca, Santa Clara, US Posted 105 days ago $124,000–$195,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

Join NVIDIA as a High-Performance LLM Training Engineer and contribute to optimizing the efficiency of large language model training workloads on thousands of GPUs using frameworks like PyTorch and JAX. Your day-to-day will involve analyzing, profiling, and tuning AI training performance across various neural networks, implementing production-quality software in NVIDIA’s deep learning platform stack from drivers to DL frameworks, and supporting submissions to MLPerf Training benchmarks. You’ll also develop tools for automated workload analysis and optimization. Ideal candidates have an MS in Computer Science or related field, extensive experience with deep learning and GPU architecture, and proficiency in C++, Python, and CUDA. This role plays a crucial part in shaping the future of AI by enhancing hardware roadmaps and enabling groundbreaking advancements in computing systems.

Skills

PyTorch JAX CUDA C++ Python GPU MLPerf DeepLearning ComputerArchitecture GPUs SystemSimulation PerformanceAnalysis AutomationTools CloudServices DataCenterIntegration

What you'll do

  • Analyze and optimize AI training workloads on GPUs using PyTorch and JAX.
  • Prioritize and solve performance issues across various neural network architectures.
  • Implement software in multiple layers of NVIDIA’s deep learning platform stack.
  • Support NVIDIA submissions to the MLPerf Training benchmark suite.
  • Develop tools for automating workload analysis and optimization workflows.

What we're looking for

  • MS in Computer Science, Electrical Engineering or equivalent experience.
  • Strong background in deep learning and neural network training.
  • Expertise in computer architecture and GPU fundamentals.
  • Experience analyzing and tuning application performance.
  • Proficiency in C++, Python, and CUDA programming.

Market check

Salary context

This $124,000–$195,500 range sits above 31% of similar postings on FindRole.

Peer median band

$152,000–$235,850

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$154,986–$235,750

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 802 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 798 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior High-Performance LLM Training Engineer

Nvidia

Us, Ca, Santa Clara, US 50 days ago $184,000–$287,500
Python C++ CUDA PyTorch JAX GPU MLPerf NVIDIA Deep Learning Computer Architecture Performance Modelling Automation Tools System Simulators Cloud Services Data Centers

Principal High-Performance LLM Training Engineer

Nvidia

Us, Ca, Santa Clara, US 30 days ago $272,000–$431,250
PyTorch JAX NeMo CUDA Distributed Systems High-Performance Computing Mixed Precision Training Activation Checkpointing Profiling Tools Tracing Tools Benchmarking Tools GPU Architecture TensorFlow Kubernetes AWS Azure Google Cloud Platform PostgreSQL CI/CD

Senior Deep Learning Software Engineer, LLM Performance

Nvidia

Us, Ca, Santa Clara, US 42 days ago $184,000–$287,500
Python C++ CUDA TensorRT Triton PyTorch JAX TensorFlow VLLM SGLang DL compiler Performance modeling Profiling Debugging Code optimization GPU programming Deep learning framework CI/CD

Deep Learning Architect, LLM Inference - New College Grad 2026

Nvidia

Us, Ca, Santa Clara, US 36 days ago $124,000–$195,500
PyTorch TRT-LLM vLLM SGLang OpenAI API MCP Python CUDA Prometheus Grafana Docker CI/CD GitHub GitLab Jupyter Notebook PostgreSQL MongoDB Kubernetes AWS Azure Google Cloud Platform

Machine Learning Applications and Compiler Engineer, LPX - New College Grad 2026

Nvidia

Us, Ca, Santa Clara, US 23 days ago $124,000–$195,500
C/C++ Rust LLVM MLIR TensorFlow PyTorch ONNX GPUs profiling tools tracing tools benchmarking tools CI/CD parallel computing heterogeneous compute architectures spatial accelerators dataflow architectures static scheduling pipeline parallelism tensor parallelism large-scale AI systems distributed inference