Senior High-Performance LLM Training Engineer
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays more than 98% of similar roles. Most pay $180,500–$246,150 — the shaded band above. At the midpoint, this role pays about $352k versus about $213k for comparable roles.
Based on 240 similar postings.
Employer
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has 896 open roles on FindRole.
Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.
Most-posted roles
At a glance
As a Principal High-Performance LLM Training Engineer, you will join the team to drive performance for large-scale AI training and post-training workloads across the full hardware and software stack. You will perform end-to-end analysis and optimization of frontier-scale LLM pre-training and post-training workloads, identifying bottlenecks in compute, memory, communication, scheduling, and kernel efficiency. Your daily work involves developing production-quality software, tools, models, and benchmarking infrastructure to improve training performance and developer velocity. You will utilize PyTorch, JAX, NeMo, and NeMo RL while leveraging expertise in CUDA libraries, distributed training techniques like tensor and pipeline parallelism, and GPU architecture. This role solves the technical challenge of achieving speed-of-light performance for transformer-based models by translating workload insights into concrete hardware and software recommendations to shape future infrastructure across the AI ecosystem.
Skills
What you'll do
What we're looking for
Related searches
More like this
Nvidia
Amd
Nvidia
Nvidia
JPMorgan Chase
Nvidia