Senior Compiler Engineer, AI Inference Platforms

Nvidia

Actively hiring
Remote (Us, Ca, Santa Clara, US) Posted 94 days ago $152,000–$241,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

NVIDIA seeks an AI & Deep Learning Compiler Engineer to join its DLC team, focusing on advancing the inference engine for large-scale applications like generative AI and recommendation systems. This role involves collaborating with deep learning software framework teams and GPU architecture experts to enhance public APIs, optimize performance, and develop compiler techniques tailored for future NVIDIA GPUs. The ideal candidate holds a Bachelor’s, Master’s, or Ph.D., with expertise in compiler technologies such as MLIR, LLVM, XLA, and Triton, alongside proficiency in CPU and GPU architectures. Knowledge of deep learning frameworks like PyTorch and JAX, along with experience in GPU kernel authoring using Nsight Compute, is essential. Additional strengths include mentoring early-career engineers and contributing to new hardware bring-up efforts.

Skills

MLIR LLVM XLA Triton PyTorch JAX Nsight Compute C++ CUDA Python

What you'll do

  • Define public APIs for deep learning software frameworks.
  • Optimize performance and analyze AI workloads for future GPUs.
  • Implement compiler techniques to enhance inference engine efficiency.
  • Craft solutions to reduce memory footprints in AI models.
  • Author GPU kernels and perform analysis using Nsight Compute.

What we're looking for

  • Bachelor’s, Master’s or Ph.D. in relevant field.
  • Experience with compiler technologies like MLIR, LLVM, XLA.
  • Proficiency in CPU and GPU architecture.
  • Deep understanding of deep learning models and frameworks.
  • Ability to author GPU kernels and perform performance analysis.
  • Mentoring experience for early-career engineers is beneficial.
  • Track record in new hardware bring-up is advantageous.

Market check

Salary context

This $152,000–$241,500 range sits above 45% of similar postings on FindRole.

Peer median band

$166,500–$241,500

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$167,340–$245,287

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 802 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 798 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior AI Compiler Engineer, MLIR

Nvidia

Remote (Us, Ca, Santa Clara, US) 36 days ago $152,000–$241,500
MLIR XLA LLVM C++ Python PyTorch JAX CUDA OpenCL
Remote

Senior Deep Learning Compiler Engineer

Nvidia

Remote (Us, Ca, Santa Clara, US) 28 days ago $152,000–$241,500
MLIR XLA TVM LLVM PyTorch CUDA C++ Python GPU CPU Embedded_Systems Cross_Compilation CI/CD
Remote

Compiler Engineer - AI Inference

Nvidia

Us, Ca, Santa Clara, US 34 days ago $152,000–$241,500
C/C++ Python MLIR LLVM CUDA TensorFlow PyTorch NVIDIA GPUs Datacenter Optimization CI/CD Git Linux Hardware/Software Co-Design Large Language Models(LLM)

Senior Deep Learning Compiler Engineer - XLA

Nvidia

Remote (Us, Ca, Santa Clara, US) 92 days ago $152,000–$241,500
C/C++ CUDA JAX PyTorch TensorFlow XLA MLIR LLVM OpenAI_Triton GPU distributed_programming performance_analysis compiler_optimizations clean_software_engineering_practices high_performance_computing
Remote