AI Software Engineer, Kernel Libraries - New College Grad 2026

Nvidia

Actively hiring Verified listing
Santa Clara, US Posted 10 days ago $124,000–$195,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

Join our team of AI systems engineers at NVIDIA to develop cutting-edge technologies for accelerating AI inference. As a senior engineer, you will design and build libraries, code generators, and GPU kernel technologies tailored for NVIDIA’s hardware architecture, focusing on efficient attention kernels, LLM inference runtimes, and domain-specific compilers. You’ll collaborate closely with cross-functional teams across deep learning frameworks and GPU architectures to innovate and optimize high-impact AI workloads. Ideal candidates have a master's degree in Computer Science or related field, 2+ years of experience in ML/DL systems development, and strong skills in Python, C/C++, and GPU kernel optimization using CUDA C/C++. Expertise in inference engines like vLLM and SGLang, machine learning compilers such as Apache TVM, and open-source contributions are highly valued.

Skills

Python C++ CUDA cuTelemetry Triton PyTorch JAX TensorFlow ONNX vLLM SGLang MLIR FlashInfer Apache TVM NVIDIA GPU Architecture Domain Specific Compilers Open Source Contributions

What you'll do

  • Design and implement new abstractions for LLM serving engines.
  • Develop efficient attention kernel implementations for AI workloads.
  • Build just-in-time domain-specific compilers and runtimes for AI inference.
  • Optimize GPU kernels to accelerate large language models and agents.
  • Contribute to open source communities like FlashInfer, vLLM, and SGLang.

What we're looking for

  • Masters degree in Computer Science, Electrical Engineering, or related field; PhD preferred
  • 2+ years of experience with ML/DL systems development
  • Strong experience in developing or using deep learning frameworks and inference engines
  • Expertise in domain-specific compiler solutions for LLM inference and training
  • Proficiency in Python and C/C++ programming
  • Experience in GPU kernel development and performance optimizations
  • Contributions to open source communities related to AI inference technologies

Market check

Salary context

This $124,000–$195,500 range sits above 24% of similar postings on FindRole.

Peer median band

$158,400–$241,500

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$162,000–$235,750

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

AI Chip Design Engineer - New College Grad 2026

Nvidia

Us, Ca, Santa Clara, US 60 days ago $100,000–$166,750
Python LangChain LangGraph AutoGen CrewAI RAGs vector databases prompt engineering knowledge graphs Verilog System Verilog temporal logic assertions GPU architectures CPU architectures HW verification methodologies

AI Chip Design Engineer - New College Grad 2026

Nvidia

Us, Ca, Santa Clara, US 59 days ago $116,000–$189,750
Python LangChain LangGraph AutoGen CrewAI RAGs vector databases prompt engineering knowledge graphs Verilog System Verilog temporal logic assertions RFL GPU architectures CPU architectures HW verification methodologies