Senior Software Engineer, NCCL

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$152,000–$241,500 / yr
Employment
Full-time
Posted
3 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $168k
This role $197k
$105k $256k
below market most similar roles pay here above market

This role pays more than 79% of similar roles. Most pay $149,500–$187,287 — the blue band above. At the midpoint, this role pays about $197k versus about $168k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, NCCL

As a Senior Software Engineer, NCCL, you will join the communication libraries and network software team to develop and maintain software for complex heterogeneous computing systems. Your primary responsibilities include designing and implementing highly-optimized communication runtimes for Deep Learning frameworks like TensorFlow and PyTorch, as well as HPC programming interfaces such as UCX for MPI and OpenSHMEM on GPU clusters. You will build system software enabling interactions among GPUs and other components while creating proof-of-concepts for new hardware features and programming models. The role requires expert C/C++ programming, Linux experience, and a deep understanding of computer system architecture and operating systems. You will work on technical problems involving parallel programming interfaces, high-performance networks like InfiniBand, and CUDA programming for high-performance computing and deep learning.

What does a Software Engineer earn in California?

Median $214500 from 1193 postings across 76 companies.

See salary data

What you'll do

  • Design, implement, and maintain highly-optimized communication runtimes for Deep Learning frameworks like NCCL.
  • Develop and maintain HPC programming interfaces such as UCX for MPI and OpenSHMEM.
  • Contribute to the development of parallel programming interface specifications.
  • Design and maintain system software to enable interactions among GPUs and other system components.
  • Create proof-of-concepts to evaluate extensions in programming models and new runtime designs.
  • Evaluate and motivate new features in hardware and software runtimes.

What we're looking for

  • M.S./Ph.D. degree in CS/CE or equivalent experience.
  • 5+ years of relevant experience.
  • Excellent C/C++ programming and debugging skills.
  • Strong experience with Linux.
  • Expert understanding of computer system architecture and operating systems.
  • Experience with parallel programming interfaces and communication runtimes.
  • Experience with CUDA programming and NVIDIA GPUs (preferred).
  • Knowledge of high-performance networks like InfiniBand or iWARP (preferred).

More like this

Similar roles

Senior Deep Learning Framework Communications Engineer

Nvidia

Remote (Santa Clara, CA) +3 9 days ago $184,000–$287,500
PyTorch JAX TRT-LLM vLLM SGLang CUDA Triton C++ Python NCCL NVSHMEM GPUDirect MPI NVIDIA Nsight Systems PyTorch Profiler High Performance Computing AI Compilers Kernel Authoring MoE
8+ yrs exp Remote

Senior System Software Engineer, GPU Performance

Nvidia

Remote (Santa Clara, CA) 3 days ago $152,000–$241,500
HPC Parallel Programming C++ Python NCCL UCX NVSHMEM MPI CUDA PyTorch TensorFlow Kubernetes Docker Ansible SLURM Infiniband RDMA Ethernet PCIe NVLink
3+ yrs exp Remote

Principal Developer, AI Networking

Nvidia

Remote (Santa Clara, CA) +3 137 days ago $272,000–$431,250
Python C++ PyTorch CUDA NCCL RDMA MPI RoCE Deep Learning Distributed Systems Bash TensorFlow High-Performance Networking Benchmarking Profiling HCA SHARP
10+ yrs exp Remote

Senior Software Engineer

Walmart

Bentonville, AR +1 6 days ago $90,000–$180,000
Python JavaScript Java Rust Dart C++ AI ML Generative AI CI/CD Automated Testing Observability Telemetry APIs Object-Oriented Programming WCAG) 2.2 AA
3+ yrs exp

Senior Software Engineer

The Walt Disney Company

Seattle, WA +1 14 days ago $150,900–$202,400
JavaScript Web Development HLS DASH DRM PlayReady Widevine Adaptive Bitrate Streaming AVC HEVC AAC EAC3 Telemetry cross platform development
5+ yrs exp Hybrid