Distinguished Engineer, Rack Scale Architecture

Nvidia

Confirmed live today High trust

Remote

Quick summary

Work type: Remote
Location: Santa Clara, CA
Employment: Full-time
Posted: 28 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $226k

$155k $298k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $189,737–$261,962.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Distinguished Engineer, Rack Scale Architecture

Role Posting Log in to save

Distinguished Engineer - Rack Scale Architecture joins the team to drive the engineering roadmap and innovation for rack system software architecture. This role involves driving the software end-to-end architecture for rack-scale products, translating forward-looking plans into formal software requirements, and ensuring high-quality, reliable software. You will work with component leads, vendors, and hyperscalar cloud service providers to align product roadmaps. Key responsibilities include developing new technologies and protocols, mentoring architects, and making critical technical decisions. Required expertise includes system architecture for scalable server systems, networking protocols like Ethernet and InfiniBand, and complex system software for accelerators such as GPUs, DPUs, or FPGAs. You must understand out-of-band and in-band management architectures, including Redfish and IPMI, while navigating the software and hardware interface for data center platform designs.

Skills

System Architecture Firmware Kernel Drivers Operating Systems Networking InfiniBand Ethernet GPU FPGA Redfish IPMI CXL UCIE HPC Post-Silicon Bring-up Left Shift Strategy

What you'll do

Drive the end-to-end software architecture for NVIDIA's rack-scale products.
Translate forward-looking product plans into clear, formal software requirements for the organization.
Serve as a trusted architectural partner to provide guidance and oversight for high-quality software.
Work directly with major customers to align their requirements with NVIDIA’s product roadmap.
Shape vendor and business partner products to meet specific NVIDIA technical needs.
Develop a roadmap for new technologies and protocols and drive their design and adoption.
Mentor architects and engineering teams to develop them into future technical leaders.
Make key technical decisions regarding system architecture in environments of high ambiguity.

What we're looking for

BS or MS degree in Computer Engineering, Computer Science, or a related field or equivalent experience.
15+ years of experience in system architecture and design.
Deep experience designing architecture for scalable and performant server systems, particularly at the SW/HW interface.
Strong understanding of networking technology and protocols such as Ethernet and InfiniBand.
Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs.
Expertise in out-of-band and in-band management architectures and protocols like Redfish and IPMI.
Experience working with platform security experts to define tradeoffs between security and ease of use.
Demonstrable experience in implementing left shift strategy to de-risk program execution.
Excellent written and verbal communication skills.
Knowledge of large-scale cloud and cluster level deployment and management systems (preferred).
Experience designing robust, resilient, and performant scale-up fabrics (preferred).
Demonstrated track record of leading data center products across the entire lifecycle (preferred).
Familiarity with CXL, UCIE, and other C2C technology architectures (preferred).
Knowledge in storage and networking technologies (preferred).

Save