Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale

Nvidia

Confirmed live yesterday Trusted
Hybrid

Quick summary

Work type
Hybrid
Location
Santa Clara, CASeattle, WA
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
124 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $193k
This role $236k
$134k $304k
below market most similar roles pay here above market

This role pays more than 85% of similar roles. Most pay $151,000–$235,750 — the blue band above. At the midpoint, this role pays about $236k versus about $193k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale

The Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale joins the DGX Cloud organization to optimize AI infrastructure for large-scale production. You will lead end-to-end performance and scalability analysis across the Kubernetes-based accelerated runtime stack, focusing on the control and data planes. Key responsibilities include designing upstream architectural changes for hyperscale clusters, improving container startup latency, and advancing confidential containers performance. You will utilize DSX simulation infrastructure to model AI-factory deployments and validate scalability across thousands of simulated GPUs. Required technical skills include expertise in Kubernetes, distributed systems, and the CNCF ecosystem, alongside proficiency in Golang and Python. You must possess deep experience with GPU operators, distributed inference serving, and performance modeling for accelerator-based platforms to reduce total cost of ownership for AI workloads.

What you'll do

  • Lead end-to-end performance and scalability analysis across the Kubernetes-based accelerated runtime stack.
  • Design and contribute upstream architectural changes to the Kubernetes control plane for hyperscale cluster operation.
  • Improve container startup and cold-start latency to enable low-latency inference scaling across thousands of GPU nodes.
  • Assess and contribute to open-source projects that optimize Kubernetes for AI workloads.
  • Advance the scalability and performance of confidential containers for encrypted inference workloads.
  • Use large-scale simulation infrastructure to model AI-factory deployments and validate scalability across thousands of simulated GPUs.
  • Design automated workload tests and integrate continuous performance testing into modern CI/CD workflows.
  • Document technical findings and present results at internal meetings and industry events like KubeCon.

What we're looking for

  • Bachelor’s or Master’s degree in Engineering or equivalent experience, ideally in Electrical, Computer Engineering, or Computer Science.
  • 8+ years of experience in computer architecture, networking, storage systems, and accelerator-based platforms.
  • Expertise in Kubernetes and familiarity with the broader CNCF ecosystem.
  • Deep experience with large-scale, parallel, distributed accelerator systems and performance optimization of AI workloads.
  • Experience with performance modeling and benchmarking for large-scale systems.
  • Proficiency in Golang and/or Python.
  • Strong familiarity with the NVIDIA software stack across training and inference.
  • Expertise with at least one major public cloud provider (e.g., AWS, Azure, GCP, or OCI).
  • Strong operational experience with any one of the Kubernetes distributions (preferred).
  • Prior experience scaling Kubernetes clusters to ultra-large node and object counts (preferred).
  • Demonstrated history of working in the open-source community (preferred).
  • Excellent communication and interpersonal abilities (preferred).
  • PhD or equivalent experience in relevant areas (preferred).

More like this

Similar roles

Senior Systems Software Engineer, Kubernetes Node Lifecycle

Nvidia

Santa Clara, CA +1 139 days ago
Kubernetes Cluster API Golang Python NVIDIA Kubernetes Engine CI/CD OS Image Packaging Cloud Infrastructure Containerd Cloud-init Packer AWS GCP Azure OCI Kubelet CVE Remediation CIS Benchmarks SBOM Flatcar Bottlerocket Azure Linux
8+ yrs exp

Senior Systems Software Engineer, Containers and Kubernetes

Nvidia

Remote (Santa Clara, CA) +2 55 days ago $184,000–$287,500
Go C Kubernetes Container Orchestration Linux Distributed Systems Cloud Computing K8s Operator framework Container Device Interface (CDI) Dynamic Resource Allocation (DRA) Systems Programming Data Structures and Algorithms Cloud Native
8+ yrs exp Remote

Senior Software Engineer, Distributed Systems Engineering

Nvidia

Remote (Santa Clara, CA) 19 days ago
Kubernetes Go Python Distributed Systems Slurm Bright Cluster Manager Cluster Operations Operator Development Monitoring Telemetry Data Structures Algorithms Systems Programming Incident Management
5+ yrs exp Remote

Senior Software Engineer, Distributed Systems Engineering

Nvidia

Remote (Santa Clara, CA) 25 days ago $184,000–$287,500
Kubernetes Go Python Distributed Systems Slurm Bright Cluster Manager Cluster Operations Operator Development Node Health Monitoring Data Structures Algorithms Systems Programming Network Telemetry Incident Management
8+ yrs exp Remote

Senior Software Engineer

Nvidia

Remote (Seattle, WA) +1 26 days ago
Kubernetes Go Linux Terraform Ansible CI/CD Gitlab Argo Flux Cloud Native Distributed Systems Observability Telemetry Container Orchestration Unix Data Structures and Algorithms
5+ yrs exp Remote