Manager, Software Architecture

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$184,000–$287,500 / yr
Posted
52 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $216k
This role $236k
$140k most similar roles pay here $303k

This role pays more than 70% of similar roles. Most pay $184,900–$246,581 — the shaded band above. At the midpoint, this role pays about $236k versus about $216k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Manager, Software Architecture

Manager, Software Architecture joins the Networking Systems & Software Architecture group within the applied research team to lead a group of systems and networking engineers. This role is responsible for building distributed AI communication systems, including libraries, frameworks, and system integrations that move data between GPUs, nodes, and storage. The manager will define technical roadmaps, manage project planning, and oversee resource allocation while fostering a culture of excellence. Key responsibilities involve solving infrastructure problems like low-level transport optimization, hardware-software co-design, and quantum computing interconnects. Candidates must possess expertise in C, C++, Rust, and Python, alongside deep knowledge of computer architecture, memory hierarchies, DMA engines, and networking. The role requires proficiency in machine learning systems concepts such as transformer architectures, KV cache mechanics, model parallelism, and distributed training patterns to support high-speed data movement for modern AI demands.

What you'll do

  • Lead and develop a team of systems and networking engineers building distributed AI communication systems.
  • Define the technical roadmap for libraries, frameworks, and system integrations in partnership with architects.
  • Balance near-term project delivery with long-term research initiatives in high-performance computing.
  • Manage project planning, resource allocation, and delivery timelines across multiple concurrent workstreams.
  • Drive architecture decisions and participate in technical reviews for systems moving data between GPUs and nodes.
  • Foster a culture of technical excellence and open collaboration within the engineering organization.
  • Oversee the development of low-level transport optimizations and hardware-software co-design solutions.

What we're looking for

  • Software engineering experience in systems software, networking, or distributed systems.
  • 3+ years of direct people management experience.
  • BS, MS, PhD, or equivalent experience in Computer Science, Computer Engineering, or a related field.
  • Proficiency in programming languages including C, C++, Rust, and Python.
  • Strong understanding of computer architecture, memory hierarchies, DMA engines, and networking.
  • Knowledge of ML systems concepts such as transformer architectures, KV cache mechanics, and distributed training.
  • Ability to scope problems, set plans, and deliver results in a fast-paced R&D environment.
  • Strong communication skills for public speaking, technical writing, and providing candid feedback.

More like this

Similar roles

Engineering Manager, Deep Learning Inference

Nvidia

Santa Clara, CA +4 37 days ago $184,000$287,500
CUDA Triton CUTLASS C++ Python vLLM SGLang FlashInfer TensorRT-LLM PyTorch NCCL NVSHMEM NIXL Multi-GPU Communication Deep Learning Inference Agile
6+ yrs exp Hybrid

Manager, Solutions Architecture

MongoDB

Beijing, China +1 17 days ago
MongoDB AWS Microsoft Azure SaaS Artificial Intelligence Software Development Multi-cloud
4+ yrs exp Hybrid

Manager, Software Engineering

Circle

Remote (San Francisco, CA) +24 28 days ago $195,000$257,500
Go Java JavaScript APIs Agile Software Engineering
7+ yrs exp Remote

Manager, Software Engineering

Alteryx

Remote 25 days ago $150,000$201,000
AWS Azure Google Cloud Platform Go Java C# Python SaaS Distributed Systems APIs CI/CD Observability Incident Management Automated Testing Cloud Platforms Backend Services
3+ yrs exp Remote