Senior Software Architect, Deep Learning and HPC Communications

Nvidia

Confirmed live yesterday High trust

Remote

Quick summary

Work type: Remote
Location: Santa Clara, CAWestford, MAAustin, TXDurham, NC
Salary: $184,000–$287,500 / yr
Posted: 2 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $213k

This role $236k

$171k most similar roles pay here $300k

This role pays more than 75% of similar roles. Most pay $190,212–$235,750 — the shaded band above. At the midpoint, this role pays about $236k versus about $213k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Architect, Deep Learning and HPC Communications

Role Posting Log in to save

As a Senior Software Architect - Deep Learning and HPC Communications, you will join the GPU Communications Libraries and Networking team to co-design next-generation data center platforms and scalable communications software. You will investigate performance bottlenecks, design new communication technologies for AI and HPC workloads, build proofs-of-concept, and perform quantitative modeling using simulations to evaluate large GPU clusters. The role requires expertise in C/C++, Linux, and parallel programming models like MPI and SHMEM, along with experience in communication runtimes such as NCCL, NVSHMEM, UCX, OpenSHMEM, or UCC. You must possess a deep understanding of operating systems, computer architecture, and network topology. The work focuses on solving the challenge of efficient, high-speed communication across thousands of GPUs connected via NVLink, PCIe, InfiniBand, and Ethernet to accelerate large-scale computational demands in the deep learning and high-performance computing domains.

Skills

C++ C CUDA NCCL NVSHMEM UCX MPI SHMEM OpenSHMEM UCC InfiniBand NVLink PCIe RoCE PyTorch TensorFlow Linux HPC Deep Learning

What you'll do

Identify and resolve performance bottlenecks in current communication systems to improve overall efficiency.
Design and implement new communication technologies specifically tailored for AI and HPC workloads.
Collaborate with hardware and software architects to co-design next-generation data center platforms.
Build proofs-of-concept and conduct experiments to evaluate and drive technical innovations.
Perform quantitative modeling to assess the performance of large-scale GPU clusters.
Use simulations to explore the scalability of communication across thousands of GPUs.

What we're looking for

M.S./Ph.D. degree in Computer Science, Computer Engineering, or equivalent experience.
5+ years of relevant experience.
Excellent C/C++ programming and debugging skills.
Experience with parallel programming models such as MPI and SHMEM.
Experience with at least one communication runtime like NCCL, NVSHMEM, OpenSHMEM, UCX, or UCC.
Deep understanding of operating systems, computer architecture, and system architecture.
Solid knowledge of network architecture, topology, algorithms, and communication scaling for AI and HPC workloads.
Strong experience with Linux.

Save