Senior Software Engineer, CUTLASS Performance

Nvidia

Confirmed live 2 days ago High trust

Quick summary

Work type: On-site
Location: Santa Clara, CAAustin, TXHillsboro, ORDurham, NCRedmond, WA
Salary: $152,000–$241,500 / yr
Posted: 102 days ago
Freshness: Confirmed live 2 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $177k

This role $197k

$105k most similar roles pay here $256k

This role pays more than 73% of similar roles. Most pay $149,350–$203,862 — the shaded band above. At the midpoint, this role pays about $197k versus about $177k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, CUTLASS Performance

Role Posting Log in to save

As a Senior Software Engineer, CUTLASS Performance, you will join the Deep Learning Library team to optimize high-performance linear algebra and Tensor Core primitives within the open-source CUTLASS ecosystem. You will be responsible for benchmarking state-of-the-art deep learning model inference and training passes to identify critical GPU kernel and fusion opportunities. Your daily work involves identifying performance gaps between theoretical and realized results, suggesting software improvements, and developing automated tooling for analysis and optimization loops. You will serve as the authoritative resource on kernel performance while collaborating with internal teams across GPU architecture and DL frameworks. The role requires proficiency in C++ and Python, a deep understanding of computer architecture and parallel processing, and experience in software performance analysis. You will address technical challenges involving matrix multiply operations and complex math for deep learning computations.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

Skills

C++ Python GPU PyTorch JAX SGLang vLLM TRT-LLM CUTLASS Performance Analysis Benchmarking Computer Architecture Deep Learning Linear Algebra

What you'll do

Benchmark performance of state-of-the-art deep learning models to identify GPU kernel and fusion opportunities.
Identify gaps between theoretical and realized performance to suggest software improvements or model adjustments.
Develop tools to automate the benchmarking, analysis, and performance optimization loop for CUTLASS kernels.
Serve as the authoritative resource on kernel performance within the team.
Represent the CUTLASS team in cross-functional engagements with GPU architecture, DL frameworks, and QA teams.

What we're looking for

Master's or PhD degree in Computer Science, Computer Engineering, or a related field (or equivalent experience).
3+ years of relevant industry experience.
Strong programming skills in Python and C++.
Experience in software performance analysis and optimization.
Deep understanding of computer architecture and familiarity with GPUs or similar parallel processing architectures.
Deep understanding of state-of-the-art deep learning model architectures.
Hands-on experience with performance benchmarking of DL frameworks like PyTorch, JAX, SGLang, vLLM, or TRT-LLM.
Experience in developing performance models and performance regression systems.