Director, Rack Scale Software Architecture

Nvidia

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CAAustin, TXDurham, NCBoulder, CO
Employment
Full-time
Posted
66 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $249k
$176k $321k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $209,000–$288,150.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Director, Rack Scale Software Architecture

The Director, Rack Scale Software Architecture leads the team responsible for rack-scale system software architecture. This role involves driving end-to-end software architecture for rack-scale products, translating forward-looking plans into formal software requirements, and ensuring high-quality, reliable software. The position requires managing firmware, kernel drivers, operating systems, networking, fabrics, and associated user mode drivers plus manageability software. Key responsibilities include providing technical leadership, making critical decisions under ambiguity, and engaging with hyperscalar and cloud service providers to align product roadmaps. Candidates must possess deep experience in designing architecture for scalable and performant server systems at the software and hardware interface. Required technical skills include experience with accelerators like GPUs, DPUs, or FPGAs, as well as knowledge of Ethernet, InfiniBand, CXL, and UCIE technology architectures.

What you'll do

  • Drive the end-to-end software architecture for NVIDIA's rack-scale products.
  • Translate product roadmaps into formal software requirements to anchor organizational execution.
  • Ensure high-quality and reliable software by serving as a trusted architectural partner for internal teams.
  • Work directly with major customers to align their requirements with NVIDIA’s product roadmap.
  • Present the team vision to senior internal and external leadership.
  • Provide technical leadership and career mentorship to the engineering team.
  • Make key technical decisions in environments characterized by high ambiguity.

What we're looking for

  • BS or MS degree in Computer Engineering, Computer Science, or a related field or equivalent experience.
  • Experience in system architecture and design.
  • 8+ years of proven experience in management.
  • Deep experience designing architecture for scalable and performant server systems, particularly at the SW/HW interface.
  • Proven leadership skills and ownership of past projects involving a large-scale, sophisticated codebase.
  • Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs.
  • Strong interactive, verbal, and written communication skills.
  • Knowledge of large-scale cloud and cluster level deployment and management systems (preferred).

More like this

Similar roles

Distinguished Engineer, Rack Scale Architecture

Nvidia

Remote (Santa Clara, CA) 28 days ago
System Architecture Firmware Kernel Drivers Operating Systems Networking InfiniBand Ethernet GPU FPGA Redfish IPMI CXL UCIE HPC Post-Silicon Bring-up Left Shift Strategy
10+ yrs exp Remote

Distinguished Engineer, Data Center System Software Architect

Nvidia

Santa Clara, CA 3 days ago $320,000–$488,750
Linux Kernel System Firmware OpenBMC SBIOS GPU FPGA InfiniBand TCP/IP Ethernet Redfish IPMI MCTP PLDM SPDM RDE CUDA cuDNN DOCA High-Performance Computing Distributed Parallel Processing left shift strategy
10+ yrs exp

Director, Server CPU Product Architecture

Nvidia

Santa Clara, CA +1 46 days ago $288,000–$437,000
CPU Architecture SoC Architecture x86 Arm Accelerated Computing AI Infrastructure Silicon Engineering System Architecture Platform Architecture Electrical Engineering Computer Science Computer Engineering
10+ yrs exp

Director, Cloud Software Architect

The Coca‑Cola Company

Atlanta, GA 4 days ago $171,000–$198,000
Microsoft Azure Google Cloud Platform Kubernetes Containers Serverless infrastructure-as-code Site Reliability Engineering SRE DevOps Zero Trust Microservices API-first Java Kotlin SAP Cloud Atlassian JIRA
8+ yrs exp

Director, Solution Architecture

JLL (Jones Lang LaSalle)

Remote (New York, NY) 33 days ago $140,000–$170,000
Solution Architecture AI LLM ETL ELT Data Modeling API Yardi MRI RealPage Entrata Argus Chatham Financial VTS Data Engineering
7+ yrs exp Remote