Distinguished Engineer - Rack Scale Architecture

Nvidia

Remote Actively hiring Posted this week Verified listing
Santa Clara, CA Posted 6 days ago $320,000$488,750 / year

At a glance

AI generated

TL;DR

NVIDIA seeks a senior technical leader to drive the engineering roadmap and innovation for its rack-scale system software architecture within its rapidly expanding data center ecosystem. This role involves deep engagement with internal teams and external cloud providers to ensure high-quality software solutions that integrate NVIDIA GPUs, NVLink, InfiniBand networking, Grace CPUs, and AI/HPC software stacks. Responsibilities include translating forward-looking plans into formal requirements, ensuring reliable software through architectural guidance, and collaborating closely with major customers to align roadmaps. The ideal candidate has over 15 years of experience in system architecture design, expertise in scalable server systems, networking technologies, and complex system software for accelerators like GPUs. Knowledge of management protocols such as Redfish and IPMI, large-scale cloud deployment, and familiarity with CXL and UCIE architectures are essential.

Skills

NVIDIA InfiniBand Redfish IPMI CXL UCIE Ethernet GPUs DPUs FPGAs System management protocols Out-of-band management In-band management Left shift strategy Cloud deployment systems Cluster management systems Resilient scale-up fabrics Security protocols Networking technologies Large-scale cloud services

What you'll do

  • Drive the software end-to-end architecture for NVIDIA's rack-scale products.
  • Translate product portfolio plans into formal software requirements guiding execution.
  • Ensure high-quality software by providing architectural guidance and oversight.
  • Work directly with major customers to align their needs with NVIDIA’s roadmap.
  • Develop and drive adoption of new technologies and protocols in the industry.
  • Mentor architects and engineering teams, fostering future technical leaders.

What we're looking for

  • 15+ years experience in system architecture and design
  • Deep expertise in scalable server systems software/hardware interface
  • Strong understanding of networking technologies and protocols
  • Experience with complex system software for accelerators like GPUs
  • Expertise in out-of-band and in-band management architectures
  • Knowledge of large-scale cloud deployment and management systems
  • Demonstrated leadership in data center product lifecycle management

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $196k
This role $404k
$114k most similar roles pay here $529k

This role pays more than 99% of similar roles. Most pay $157,115–$235,750 — the shaded band above. At the midpoint, this role pays about $404k versus about $196k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 824 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 812 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Solutions Architect - Rack Scale AI Systems

Nvidia

Santa Clara, CA 126 days ago $208,000$333,500
Linux Python Kubernetes Terraform AWS GCP Azure Docker CI/CD Prometheus Grafana PostgreSQL Ansible Git InfiniBand MPI NVIDIA GPUs Tegra Processors

Rack Systems Architect

Qualcomm

Santa Clara, CA 37 days ago $220,200$330,400
OCP ORv3 Rack-Level_Design PCIe Ethernet CXL Liquid_Cooling DLC RDHx Immersion_Cooling High_Speed_Architectures Power_Systems Thermal_Management Cross_Functional_Team_Leadership System_Integration Deployment_Readiness Reliability_Engineering

Solutions Architect, Hyperscale

Nvidia

Santa Clara, CA 145 days ago $152,000$218,500
NVIDIA AI ML HPC GPU PCIe Networking Performance benchmarking Cloud Service Providers Meta Conferencing tools CI/CD
Hybrid

Application Infrastructure Engineer

Booz Allen Hamilton

Fort Meade, MD 6 days ago $86,900$198,000
VMware vSphere NSX Linux Windows Shell Scripting PowerShell Python Cisco Juniper Infrastructure as Code CI/CD

Infra Systems Physical Architect

Qualcomm

San Diego, CA 149 days ago $140,000$210,000
Python TCL Linux Unix shell C Design Compiler Fusion Compiler Genus Primetime Prime Power Innovus AMBA Protocol Cache Coherency mechanisms Physical Aware Synthesis Physical Aware DFT Clock Tree Planning MESH CTS Custom Placement and Routing Formal Verification Power Domain Analysis