Software Engineer, CUDA Deep Learning Systems

Nvidia

Confirmed live 2 days ago High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CAAustin, TX
Salary
$124,000–$195,500 / yr
Posted
11 days ago
Freshness
Confirmed live 2 days ago
Closes
Nov 1, 2026

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $204k
This role $160k
$109k most similar roles pay here $268k

This role pays less than 80% of similar roles. Most pay $169,500–$239,462 — the shaded band above. At the midpoint, this role pays about $160k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Software Engineer, CUDA Deep Learning Systems

Software Engineer, CUDA Deep Learning Systems will join a research-oriented team focused on the intersection of advanced deep learning architectures and low-level hardware optimization. The role involves researching and prototyping novel systems optimizations for deep learning models through modeling, simulation, and silicon prototyping. Key responsibilities include architecting distributed computing systems that scale from single nodes to cluster-scale supercomputing environments, designing custom high-performance CUDA kernels, and analyzing complex hardware-software interactions to resolve bottlenecks in training and inference pipelines. The candidate will utilize C++, Python, and CUDA programming while working with frameworks like PyTorch or JAX and communication libraries such as NCCL or MPI. This role addresses the technical challenge of maximizing accelerator compute utilization and memory bandwidth for emerging workloads, including large language models, vision models, and diffusion architectures across massive-scale distributed computing systems.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Prototype novel systems optimizations for deep learning models at the intersection of high-level frameworks and low-level CUDA.
  • Architect and optimize distributed computing systems that scale from single nodes to massive cluster-scale supercomputing environments.
  • Design, implement, and optimize custom high-performance CUDA kernels tailored to emerging neural network architectures.
  • Analyze hardware-software interactions to identify and resolve performance bottlenecks in training and inference pipelines.
  • Develop exploratory tools and runtime systems to profile and accelerate new paradigms in deep learning.
  • Write maintainable code for prototypes intended for open-source releases, framework integrations, or commercial products.

What we're looking for

  • BS, MS, or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • At least 2 years of relevant industry experience or equivalent academic experience after obtaining a degree.
  • Strong proficiency in C++ and Python programming.
  • Solid background in deep learning fundamentals with a specific focus on transformers.
  • Strong understanding of distributed computing principles, multi-node scaling, and cluster-scale execution performance challenges.
  • Proven experience in systems programming, computer architecture, and low-level systems performance optimization.
  • Hands-on experience with CUDA programming, kernel optimization, and workload profiling on GPU architectures.
  • Experience profiling and optimizing generative AI models, including large language models, vision models, or diffusion models.

More like this

Similar roles

Senior Software Engineer, CUDA Deep Learning Systems

Nvidia

Remote (Santa Clara, CA) +1 11 days ago $184,000$287,500
CUDA C++ Python Deep Learning PyTorch JAX TensorRT vLLM Triton XLA NCCL MPI UCX Distributed Computing Kernel Optimization Model Optimization FP8 INT8
8+ yrs exp Remote

Senior Deep Learning Frameworks CUDA Software Engineer

Nvidia

Remote (Santa Clara, CA) +1 11 days ago $184,000$287,500
CUDA PyTorch JAX C++ Python TRT-LLM vLLM SGLang TensorRT Triton NCCL MPI UCX XLA HPC Kernel Authoring NVIDIA Nsight Systems Compiler Technologies
8+ yrs exp Remote

Senior Deep Learning Software Engineer

Nvidia

Santa Clara, CA +2 18 days ago $152,000$241,500
MLIR C++ Python Compiler Optimization NVIDIA GPU LLM Inference Computational Graph Optimization Kernel Code Generation Performance Analysis AI Workloads Software Design Debugging Test Development
3+ yrs exp

Senior DL Compiler Engineer, CUDA Tile

Nvidia

Remote (Santa Clara, CA) +4 9 days ago $152,000$241,500
CUDA C++ C MLIR LLVM XLA TVM Compiler Optimization GPU Architecture Performance Analysis Deep Learning IR Design OpenCL
3+ yrs exp Remote

Senior Deep Learning Compiler Engineer

Nvidia

Remote (Santa Clara, CA) +1 134 days ago $152,000$241,500
C++ Python CUDA OpenCL MLIR XLA TVM LLVM PyTorch GPU Architecture Compiler Optimization Deep Learning Kernel Generation cross compilation Performance Analysis
3+ yrs exp Remote