Software Engineer, AI and DL Kernel Libraries - New College Grad 2026

Nvidia

Remote Actively hiring Verified listing
Remote, US · Santa Clara, CA Posted 10 days ago $124,000–$195,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

Join our team of AI systems engineers at NVIDIA to develop cutting-edge technologies for the inference software stack, focusing on libraries, code generators, and GPU kernel technologies tailored for NVIDIA’s hardware architecture. You will innovate by designing efficient attention kernels and new LLM inference runtime components while collaborating with cross-functional teams across deep learning frameworks and GPU architectures. Key responsibilities include building just-in-time domain-specific compilers and runtimes to accelerate high-impact AI workloads, contributing to open-source projects like FlashInfer, vLLM, and SGLang. Ideal candidates have a master’s degree in Computer Science or related field, with experience in deep learning frameworks such as PyTorch and TensorFlow, strong Python and C/C++ programming skills, and expertise in GPU kernel development using CUDA C/C++.

Skills

Python C/C++ CUDA C/C++ cuTile Triton FlashInfer vLLM SGLang Apache TVM MLIR PyTorch JAX TensorFlow ONNX

What you'll do

  • Design and implement new abstractions for LLM serving engines.
  • Develop efficient attention kernel implementations for AI workloads.
  • Build just-in-time domain-specific compilers and runtimes for inference.
  • Optimize GPU kernels to accelerate large language models and agents.
  • Contribute to open source communities like FlashInfer, vLLM, and SGLang.

What we're looking for

  • Masters degree in Computer Science, Electrical Engineering, or related field; PhD preferred
  • 2+ years of experience with ML/DL systems development
  • Strong experience in developing or using deep learning frameworks and inference engines
  • Expertise in GPU kernel development and performance optimizations using CUDA C/C++
  • Background in domain-specific compiler solutions for LLM inference and training

Market check

Salary context

This $124,000–$195,500 range sits above 32% of similar postings on FindRole.

Peer median band

$152,000–$240,350

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$152,875–$235,750

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

AI Software Engineer, Kernel Libraries - New College Grad 2026

Nvidia

Us, Ca, Santa Clara, US 10 days ago $124,000–$195,500
Python C++ CUDA cuTelemetry Triton PyTorch JAX TensorFlow ONNX vLLM SGLang MLIR FlashInfer Apache TVM NVIDIA GPU Architecture Domain Specific Compilers Open Source Contributions

Machine Learning Applications and Compiler Engineer, LPX - New College Grad 2026

Nvidia

Us, Ca, Santa Clara, US 24 days ago $124,000–$195,500
C/C++ Rust LLVM MLIR TensorFlow PyTorch ONNX GPUs profiling tools tracing tools benchmarking tools CI/CD parallel computing heterogeneous compute architectures spatial accelerators dataflow architectures static scheduling pipeline parallelism tensor parallelism large-scale AI systems distributed inference