Software Engineering Manager, GPU Communications Libraries

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
5 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $220k
This role $236k
$151k $302k
below market most similar roles pay here above market

This role pays more than 70% of similar roles. Most pay $196,750–$243,700 — the blue band above. At the midpoint, this role pays about $236k versus about $220k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Software Engineering Manager, GPU Communications Libraries

The Software Engineering Manager - GPU Communications Libraries will join the GPU Communications Libraries and Networking team to lead, mentor, and grow a library engineering team. This technical leadership role involves managing the planning, execution, quality, and performance of the NVSHMEM and UCX libraries. The manager will participate in feature design and implementation, interact with researchers to understand use cases, and collaborate with engineering teams to define the product roadmap. Key responsibilities include identifying process improvements and managing complex software features through the full product life cycle. Candidates must possess expertise in C/C++ programming in Linux, systems software fundamentals, and hardware-software interactions. The role addresses the challenge of optimizing communication performance between GPUs connected via high-speed interconnects like NVLink, PCIe, InfiniBand, and Ethernet for Deep Learning and HPC applications.

What does a Software Engineering Manager earn in California?

Median $281300 from 43 postings across 15 companies.

See salary data

What you'll do

  • Lead, mentor, and grow the library engineering team.
  • Manage the planning, execution, quality, and performance of NVSHMEM and UCX libraries.
  • Participate in the design and implementation of new software features.
  • Interact with internal and external partners to identify specific use cases and requirements.
  • Collaborate with engineering and product management to define the product roadmap.
  • Identify and implement improvements in established processes, infrastructure, and engineering practices.

What we're looking for

  • Experience in the software industry specializing in HPC networking or system software.
  • 4+ years of management experience.
  • BS, MS, or Ph.D. in CS, CE, EE, or a related technical field, or equivalent experience.
  • Experience in systems software, communication runtimes, or high-performance networking software development with a track record of full product life cycle delivery.
  • Strong understanding of computer system architecture, operating systems principles, HW-SW interactions, and performance analysis/optimizations.
  • Excellent C/C++ programming and debugging skills in Linux.
  • Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC) (preferred).
  • Experience with CUDA, MPI, OpenMP, OpenACC, pthreads, RDMA, or high-performance networking technologies (preferred).

More like this

Similar roles

Senior System Software Engineer, GPU Performance

Nvidia

Remote (Santa Clara, CA) 3 days ago $152,000–$241,500
HPC Parallel Programming C++ Python NCCL UCX NVSHMEM MPI CUDA PyTorch TensorFlow Kubernetes Docker Ansible SLURM Infiniband RDMA Ethernet PCIe NVLink
3+ yrs exp Remote

Senior Software Engineer, NCCL

Nvidia

Santa Clara, CA 3 days ago $152,000–$241,500
C++ CUDA PyTorch TensorFlow NCCL UCX MPI OpenSHMEM Linux GPU InfiniBand iWARP High-Performance Computing Deep Learning Operating Systems
5+ yrs exp

Senior Deep Learning Framework Communications Engineer

Nvidia

Remote (Santa Clara, CA) +3 9 days ago $184,000–$287,500
PyTorch JAX TRT-LLM vLLM SGLang CUDA Triton C++ Python NCCL NVSHMEM GPUDirect MPI NVIDIA Nsight Systems PyTorch Profiler High Performance Computing AI Compilers Kernel Authoring MoE
8+ yrs exp Remote

Principal Developer, AI Networking

Nvidia

Remote (Santa Clara, CA) +3 137 days ago $272,000–$431,250
Python C++ PyTorch CUDA NCCL RDMA MPI RoCE Deep Learning Distributed Systems Bash TensorFlow High-Performance Networking Benchmarking Profiling HCA SHARP
10+ yrs exp Remote

Senior Deep Learning Communication Architect

Nvidia

Santa Clara, CA +1 160 days ago $184,000–$287,500
Deep Learning PyTorch TensorRT-LLM vLLM SGLang C++ Python CUDA OpenCL NCCL MPI UCX NVLink InfiniBand RoCE Triton FSDP Data Parallelism Pipeline Parallelism Tensor Parallelism Expert Parallelism
6+ yrs exp