Senior Software Engineer, NCCL

Nvidia

Actively hiring
Santa Clara, US Posted 15 days ago $152,000–$241,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

Join our communication libraries and network software team as a senior software engineer, where you will design, implement, and maintain highly-optimized runtimes for Deep Learning frameworks like TensorFlow and Pytorch on GPU clusters. You’ll contribute to parallel programming interface specifications such as MPI and OpenSHMEM, develop system software enabling interactions among GPUs and other components, and create proof-of-concepts to drive innovation in hardware and runtime designs. Ideal candidates have a strong background in C/C++ programming, Linux, computer architecture, and operating systems, along with experience in CUDA, high-performance networks like InfiniBand, and HPC applications. This role requires excellent collaborative skills and the ability to work effectively across diverse teams globally.

Skills

C C++ Linux CUDA InfiniBand iWARP MPI OpenSHMEM NCCL UCX PyTorch TensorFlow HPC GPU

What you'll do

  • Design and implement highly-optimized communication runtimes for Deep Learning frameworks on GPU clusters.
  • Contribute to parallel programming interface specifications like MPI/OpenSHMEM.
  • Develop system software enabling interactions among GPUs and other system components.
  • Create proof-of-concepts to evaluate new designs in runtimes and hardware features.
  • Maintain complex heterogeneous computing systems that power disruptive products.

What we're looking for

  • M.S./Ph.D. in CS/CE or equivalent experience.
  • Expertise in C/C++ programming and Linux.
  • Deep understanding of computer system architecture and operating systems.
  • Experience with parallel programming interfaces and communication runtimes.
  • Knowledge of high-performance networks like InfiniBand, iWARP.
  • Proficiency with CUDA programming and NVIDIA GPUs.
  • Strong collaborative skills for multi-national, multi-time-zone environments.

Market check

Salary context

This $152,000–$241,500 range sits above 76% of similar postings on FindRole.

Peer median band

$117,000–$209,315

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$139,050–$196,750

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Software Engineer, Senior

Booz Allen Hamilton

Locations Annapolis Junction, Maryland, US 36 days ago $86,900–$198,000
Python C++ Git JUnit CppUnit PHP JavaScript WordPress Moodle Docker

Software Engineer, Senior

Booz Allen Hamilton

US 46 days ago $86,900–$198,000
React Next.JS Git Jenkins GitLab CI/CD Express Flask Spring FastAPI Python Docker Kubernetes Elasticsearch Kibana Redis Kafka Nginx AWS HAProxy Grafana

Software Engineer, Senior

Booz Allen Hamilton

Locations Herndon, Virginia, US 63 days ago $86,800–$198,000
Java Kubernetes Docker Spring_Framework REST_API AWS Bitbucket Jenkins Linux CI/CD Ansible MongoDB Apache_NiFi Kafka

Software Engineer, Senior

Booz Allen Hamilton

Locations Dayton, Ohio, US 51 days ago $112,800–$257,000
Python Agile Jenkins GitHub Actions Git CI/CD

Software Engineer, Senior

Booz Allen Hamilton

Locations Herndon, Virginia, US 63 days ago $86,800–$198,000
Java Kubernetes Docker Spring Framework Spring Boot AWS Bitbucket Jenkins Linux REST CI/CD Ansible MongoDB Apache NiFi Kafka