Senior Software Engineer, CUDA Deep Learning Systems
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays more than 73% of similar roles. Most pay $181,593–$241,750 — the shaded band above. At the midpoint, this role pays about $236k versus about $212k for comparable roles.
Based on 240 similar postings.
Employer
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has 896 open roles on FindRole.
Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.
Most-posted roles
At a glance
As a Senior Deep Learning Frameworks CUDA Software Engineer, you will join the team responsible for core CUDA features and runtimes to scale Deep Learning and HPC applications. You will integrate new CUDA features and runtime abstractions into AI stacks like PyTorch, TRT-LLM, vLLM, SGLang, and JAX. Your daily responsibilities include performing deep analysis of AI workloads, designing fault-tolerant solutions for large-scale multi-GPU systems, and improving the AI compiler-runtime interface to achieve speed-of-light performance. You will develop exploratory tools to accelerate new paradigms while ensuring code transitions smoothly into production or open-source releases. The role requires expertise in C++, Python, CUDA, and distributed machine learning techniques like pipeline and tensor parallelism. You will solve complex problems regarding multi-GPU demands ranging from massive training scales to microsecond latency inference across various AI models.
Skills
What you'll do
What we're looking for
More like this
Nvidia
Nvidia
Nvidia
Nvidia
Nvidia
Nvidia