Distinguished Engineer – Data Center System Software Architect

Nvidia

Actively hiring
Santa Clara, US Posted 16 days ago $320,000–$488,750 / year
View original post Log in to save

At a glance

AI generated

TL;DR

Join NVIDIA’s data center systems team as a senior technical architect responsible for the end-to-end architecture of advanced platforms like DGX and HGX, integrating GPUs, NVLink, InfiniBand networking, Grace CPUs, and optimized AI software. You will lead technical innovation by engaging with major hyperscalers to define KPIs, gather requirements, and address complex queries, ensuring alignment between NVIDIA’s roadmap and customer needs. Your daily tasks include developing new technologies, making critical decisions in ambiguous situations, and implementing left-shift strategies to mitigate risks. Ideal candidates possess deep expertise in server system architecture, extensive experience with complex system software for accelerators, mastery of firmware and Linux kernel internals, proficiency in management protocols like Redfish and IPMI, and knowledge of advanced networking concepts. Additionally, familiarity with NVIDIA’s HPC programming models and enterprise storage architectures is crucial, as well as a proven track record in leading large-scale projects and contributing to standards bodies such as OCP and DMTF.

Skills

Linux NVIDIA GPUs InfiniBand TCP/IP Ethernet Redfish IPMI MCTP PLDM SPDM RDE OpenBMC CUDA cuDNN DOCA OCP DMTF HPC CI/CD

What you'll do

  • Lead technical discussions and define KPIs for major customers in data center products.
  • Architect next-generation data center products through strategic collaborations with hyperscalers.
  • Align NVIDIA's roadmap with customer requirements to ensure product relevance.
  • Develop new technologies and protocols, driving their adoption within the industry.
  • Make critical technical decisions to mitigate risks in ambiguous situations.

What we're looking for

  • Deep expertise in scalable server system architecture and SW/HW interfaces.
  • Extensive experience with complex system software for GPUs and other accelerators.
  • Mastery of system firmware, embedded systems, and Linux kernel internals.
  • Proficiency in Out-of-Band management architectures and device management protocols.
  • Extensive knowledge of networking technologies including InfiniBand and advanced routing concepts.
  • Experience leading cross-functional projects and implementing left-shift strategies.
  • 20+ years of experience in system architecture and design.

Market check

Salary context

This $320,000–$488,750 range sits above 99% of similar postings on FindRole.

Peer median band

$132,250–$225,000

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$142,400–$223,712

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Software Architect - Data Center Systems

Nvidia

Remote (Us, Ca, Santa Clara, US) 15 days ago $224,000–$356,500
Deep Learning HPC Redfish IPMI MCTP PLDM RDE Kubernetes Docker CI/CD AWS Azure Google Cloud Platform PostgreSQL Python C++ Networking Technologies Storage Technologies Terraform Prometheus Grafana
Remote

Data Center Design Engineer (University Grad)

Qualcomm

San Diego, Ca,Us, US 50 days ago
AutoCAD Microsoft Visio Data center operations Cooling fundamentals Airflow Heat transfer Liquid cooling concepts Rack elevation planning Floor layout design Power distribution Server hardware Networking hardware Storage hardware Analytical skills Problem-solving skills Written communication Verbal communication Process documentation

Data Center Engineer II - Adyen

Ayden

US 48 days ago $169,000–$232,000
DCIM DataCenter ProjectManagement VendorManagement AssetManagement HighPerformanceComputing SupplyChain Logistics Procurement InventoryManagement NetworkEngineering PlatformIntegration TechnicalOversight MaintenancePlanning GlobalTravel HandsOnOperations OperationalStrategy CriticalInfrastructure ThermalManagement

Senior Architect, Data Center Modeling

Nvidia

Remote (Us, Ca, Santa Clara, US) 140 days ago $184,000–$287,500
Python pandas Kubernetes Terraform AWS CI/CD Docker Prometheus Grafana PostgreSQL Git Jenkins
Remote