Senior Compiler Engineer, AI

Nvidia

Confirmed live yesterday High trust

Remote

Quick summary

Work type: Remote
Location: Santa Clara, CARedmond, WA
Salary: $184,000–$287,500 / yr
Employment: Full-time
Posted: 3 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $183k

This role $236k

$113k $306k

below market most similar roles pay here above market

This role pays more than 92% of similar roles. Most pay $152,150–$214,250 — the blue band above. At the midpoint, this role pays about $236k versus about $183k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1792 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1179 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Compiler Engineer, AI

Role Posting Log in to save

Senior Compiler Engineer - AI The Senior Compiler Engineer - AI joins the Deep Learning Compiler Technology team to develop advanced compiler and runtime technology for the deep learning community. This role focuses on building JaxPP, an open-source library for pipeline parallelism in JAX. You will design and implement program transformations on jaxpr for large-scale training, including pipeline schedules, task placement, sharding, and communication overlap. Key responsibilities involve compiling graph intermediate representations to target specific code and building distributed runtimes that dispatch programs to many GPUs using NCCL. You will utilize C/C++, Python, JAX, XLA, and MPI to optimize training for large-scale distributed systems and mixture-of-experts models. The work involves collaborating with hardware and software framework teams to accelerate deep learning software and integrating JaxPP into frameworks like MaxText.

Skills

JAX XLA C++ Python Distributed Systems Compiler Design NCCL PyTorch CUDA MPI MLIR StableHLO NVSHMEM RDMA Parallel Computing Deep Learning MaxText Megatron-LM

What you'll do

Design and implement program transformations on JAX programs for large-scale training.
Develop technologies to optimize compilers and runtime execution frameworks for distributed systems.
Compile graph intermediate representations to target specific code for deep learning workloads.
Build distributed runtimes to dispatch per-stage programs and move data via NCCL.
Integrate JaxPP into JAX training frameworks like MaxText.
Maintain the open-source JaxPP project by ensuring compatibility with new JAX releases.
Perform performance tracking and debugging for large-scale training runs with partner companies.

What we're looking for

Masters or PhD in Computer Science, Computer Engineering, or a related field or equivalent experience.
6+ years of relevant work or research experience in compilers, distributed systems, or deep learning training.
Experience in compiler design and implementation.
Experience in distributed system design, development, and deployment.
Experience with deep learning frameworks such as JAX or PyTorch.
Proficiency in C/C++ and Python programming with excellent software design, debugging, and performance analysis skills.
Experience with parallel computing libraries such as MPI.
Experience with JAX internals, XLA, StableHLO, or MLIR (preferred).

Save