Principal Software Engineer, Rack-Scale System Software

Nvidia

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CAAustin, TX
Salary
$272,000–$431,250 / yr
Posted
5 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $204k
This role $352k
$108k most similar roles pay here $466k

This role pays more than 99% of similar roles. Most pay $174,600–$232,850 — the shaded band above. At the midpoint, this role pays about $352k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Software Engineer, Rack-Scale System Software

As a Principal Software Engineer, Rack-Scale System Software — CSP Engagements, you will serve as the technical focal point for rack-scale system software and firmware within the CSP Engagements team. You will collaborate with cross-functional teams to ensure cloud service providers can reliably deploy, monitor, and operate systems at fleet scale. Your daily responsibilities include driving architecture alignment for fabric management, link health monitoring, GPU/NVSwitch error handling, and firmware update orchestration. You will also manage health telemetry APIs, SW-driven serviceability features like hot-plug support, and multi-component firmware coordination. The role requires expertise in system software, platform firmware, distributed systems, and cluster management. You will utilize your knowledge of error recovery design patterns, fault isolation, and telemetry systems to solve complex problems regarding large-scale infrastructure reliability and operational efficiency for high-performance computing environments.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Align rack-scale software and firmware architectures for fabric management, link health monitoring, and error handling.
  • Lead technical work streams with CSP teams to ensure they understand NVSwitch behavior and recovery policies.
  • Synthesize customer feedback on telemetry APIs and serviceability workflows into internal architecture decisions.
  • Identify cross-CSP patterns in system issues to drive improvements in documentation, tooling, and test strategies.
  • Execute a left-shift strategy to identify and complete customer-side integration work before hardware availability.
  • Make critical technical decisions regarding software trade-offs and mitigate execution risks through early engagement.
  • Ensure customer operational requirements for fleet-scale deployment are reflected in system software development.

What we're looking for

  • 15+ years of experience in system software, platform firmware, or large-scale distributed systems engineering.
  • BS or MS in Computer Science, Electrical Engineering, or a related field.
  • Deep understanding of rack-scale system software challenges including multi-component coordination and error propagation.
  • Experience with fabric management software, cluster management, or system-level orchestration frameworks.
  • Familiarity with firmware architectures and update lifecycle management.
  • Understanding of error handling and recovery design patterns in distributed systems.
  • Experience with health monitoring and telemetry systems for fleet-level observability.
  • Proven success providing technical leadership across organizational boundaries and influencing system software design.

More like this

Similar roles

Principal Software Engineer, CSP Engagements

Nvidia

Santa Clara, CA 6 days ago $272,000$431,250
System Software Architecture x86 ARM aarch64 Linux Kernel Device Drivers CUDA GPU Computing CXL Memory Fabric Performance Analysis High-Performance Computing Hardware/Software Interface
10+ yrs exp

Principal Software Engineer, GPU Firmware and GPU System Software

Nvidia

Remote 5 days ago $272,000$431,250
GPU Firmware GPU System Software VBIOS InfoROM NVLink Firmware Update Orchestration Multi-tenancy Isolation Secure Boot Attestation ECC Power Management Telemetry Xid Errors Driver Stack Fleet Management Rollback Strategy
10+ yrs exp Remote

Principal Core Infrastructure Engineer

Oracle

Nashville, TN 34 days ago $114,600$234,600
Oracle Cloud Infrastructure Microservices Firmware SmartNIC ILOM NVIDIA AMD Intel Automation Pipelines Observability Hardware-Software Integration
8+ yrs exp

Principal Software Engineer, Core Infrastructure

Oracle

Nashville, TN 27 days ago $114,600$234,600
Distributed Systems System Design Infrastructure as Code (IaC) Data Processing Telemetry Monitoring Alerting Fault Injection rate‑limiting Encryption Cloud Infrastructure Scalability Automation