Principal Software Architect, Networking AI

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$272,000–$431,250 / yr
Employment
Full-time
Posted
69 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $217k
This role $352k
$124k $464k
below market most similar roles pay here above market

This role pays more than 98% of similar roles. Most pay $184,325–$249,525 — the blue band above. At the midpoint, this role pays about $352k versus about $217k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1463 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1096 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Software Architect, Networking AI

The Principal Software Architect, Networking will join the team to build the future of AI data-centers. This role focuses on leading the development of next-generation Scale-up fabric for AI data-centers, specifically concentrating on collaborative communication and the vertical co-development of AI networks alongside hardware, software, and applications. The architect will guarantee scalability, reliability, and robust training for large model development while creating innovative concepts for full-scale manufacturing. Key responsibilities include collaborating with cross-functional teams to implement new technologies and solving problems related to large model training scalability. Required expertise includes over 15 years of experience in software architecture and networking, a Bachelor’s degree in Engineering, and strong expertise in AI applied research, resiliency, and tail-robust training methods within large-scale AI data-center operations.

What you'll do

  • Lead the development of next-generation Scale-up fabric for AI data-centers.
  • Manage collaborative communication and vertical co-development of AI networks with hardware and software.
  • Ensure scalability, reliability, and robust training for large-scale model development.
  • Create innovative concepts for transition into full-scale manufacturing.
  • Implement new technologies in partnership with cross-functional teams.
  • Drive innovation for large-scale production environments.

What we're looking for

  • Experience in software architecture and networking.
  • Bachelor’s degree in Engineering or equivalent experience.
  • Strong expertise in AI applied research.
  • Demonstrated ability to lead complex projects and deliver flawless results.
  • Excellent collaboration skills and the ability to work with diverse teams.
  • Advanced degree or equivalent experience in Engineering or a related area (preferred).
  • Experience with large-scale AI data-center operations (preferred).
  • Outstanding abilities in resiliency and tail-robust training methods (preferred).

More like this

Similar roles

Senior Software Architect, Networking AI

Nvidia

Remote (Santa Clara, CA) +1 25 days ago $184,000–$287,500
Software Architecture Networking AI Large Model Training Data-Center Operations Scale-up Fabric Collaborative Communication
6+ yrs exp Remote

Principal Software Engineer, AI Networking

Nvidia

Santa Clara, CA 96 days ago
C/C++ RDMA RoCE InfiniBand DPDK DOCA NCCL CUDA Networking Protocols Distributed Systems Firmware Performance Tuning Congestion Control QoS Telemetry Automation
10+ yrs exp

Senior Software Architect, AI Systems and Networking

Nvidia

Santa Clara, CA +1 144 days ago
C C++ Rust RDMA NVLink GPUDirect InfiniBand RoCE vLLM SGLang TensorRT-LLM NVMe-oF GPUDirect Storage S3 Distributed Training Model Parallelism Transformer Architectures Performance Profiling Systems Programming
10+ yrs exp

Networking Architect

Nvidia

Santa Clara, CA 81 days ago $124,000–$195,500
RDMA RoCE Python C++ ASIC Design Network Topologies Load Balancing Congestion Control Computer Networks Algorithms Open Source Accelerated Computing
4+ yrs exp

Senior Networking Architect

Nvidia

Santa Clara, CA 81 days ago $152,000–$241,500
RDMA RoCE Python C++ ASIC Design Routing Protocols Load Balancing Congestion Control Network Topologies Real-time Software Open Source Accelerated Computing
5+ yrs exp Hybrid

Senior Software Engineer, AI Networking

Nvidia

Austin, TX +1 136 days ago $184,000–$287,500
C/C++ RoCE InfiniBand RDMA DPDK DOCA NCCL CUDA Networking Protocols Distributed Systems Firmware OS Performance Tuning Congestion Control QoS Telemetry Automation
8+ yrs exp