Senior Software Engineer, NCCL

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$152,000–$241,500 / yr
Posted
3 days ago
Freshness
Confirmed live yesterday
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $165k
This role $197k
$105k most similar roles pay here $256k

This role pays more than 80% of similar roles. Most pay $144,350–$184,825 — the shaded band above. At the midpoint, this role pays about $197k versus about $165k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, NCCL

Role Posting Log in to save

As a Senior Software Engineer, NCCL, you will join the communication libraries and network software team to develop and maintain software for complex heterogeneous computing systems used in High Performance Computing and Deep Learning. Your daily responsibilities include designing and maintaining highly-optimized communication runtimes for Deep Learning frameworks like TensorFlow and PyTorch, as well as HPC programming interfaces such as UCX for MPI/OpenSHMEM on GPU clusters. You will also develop system software to enable interactions between GPUs and other components while creating proof-of-concepts to evaluate new hardware features and runtime designs. The role requires expert C/C++ programming skills, Linux experience, and a deep understanding of computer system architecture. Preferred technical expertise includes CUDA programming, high-performance networks like InfiniBand or iWARP, and familiarity with various Deep Learning frameworks and HPC applications.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

Skills

C++ C CUDA NVIDIA GPUs PyTorch TensorFlow NCCL UCX MPI OpenSHMEM Linux High-Performance Computing InfiniBand iWARP Parallel Programming Deep Learning Frameworks

What you'll do

  • Design and maintain optimized communication runtimes for Deep Learning frameworks like NCCL.
  • Develop and maintain HPC programming interfaces such as UCX for MPI and OpenSHMEM.
  • Contribute to the development of parallel programming interface specifications.
  • Build system software to enable interactions between GPUs and other system components.
  • Create proof-of-concepts to evaluate new designs in runtimes and hardware features.
  • Develop software for complex heterogeneous computing systems used in High Performance Computing.

What we're looking for

  • M.S./Ph.D. degree in CS/CE or equivalent experience.
  • 5+ years of relevant experience.
  • Excellent C/C++ programming and debugging skills.
  • Strong experience with Linux.
  • Expert understanding of computer system architecture and operating systems.
  • Experience with parallel programming interfaces and communication runtimes.
  • Experience with CUDA programming and NVIDIA GPUs.
  • Knowledge of high-performance networks like InfiniBand or iWARP.

Related searches

More Senior Software Engineer jobs Senior Software Engineer jobs in Santa Clara All jobs at Nvidia

More like this

Similar roles

Senior System Software Engineer, GPU Performance

Nvidia

Remote 6 days ago $152,000–$241,500
HPC C++ Python CUDA NCCL UCX NVSHMEM MPI Infiniband Ethernet RDMA PyTorch TensorFlow Kubernetes Docker SLURM Ansible Performance Engineering Parallel Programming
Remote
Save

Principal Deep Learning Communication Architect

Nvidia

Remote (Santa Clara, CA) +1 150 days ago $272,000–$431,250
NCCL UCX UCC NVSHMEM CUDA InfiniBand RDMA RoCE TensorRT-LLM vLLM SGLang Megatron-Core DeepSpeed JAX XLA PyTorch Distributed Ray HPC High-Performance Computing
10+ yrs exp Remote
Save

Senior Software Engineer

Genworth Financial

Richmond, VA +1 61 days ago $96,700–$145,000
Python Flask Azure PostgreSQL GitLab CI/CD DevSecOps JavaScript HTML CSS React Angular Vue Azure App Service Azure Synapse Pipelines SQL
5+ yrs exp Hybrid
Save

Senior Software Engineer

Datadog

96 days ago $192,000–$240,000
Go Python C Redis Cassandra Kafka Data Pipelines AI Backend Systems Feature Flags Statistics
6+ yrs exp Hybrid
Save