Systems Software Engineer, AI and Cloud

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$108,000–$178,250 / yr
Employment
Full-time
Posted
5 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $194k
This role $143k
$93k $251k
below market most similar roles pay here above market

This role pays less than 81% of similar roles. Most pay $151,913–$235,750 — the blue band above. At the midpoint, this role pays about $143k versus about $194k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1463 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1096 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Systems Software Engineer, AI and Cloud

JOB TITLE: Systems Software Engineer, AI and Cloud - New College Grad 2026 As a Systems Software Engineer, AI and Cloud - New College Grad 2026, you will join a team focused on developing cloud-native, full-stack applications using microservices architecture to power AI use cases. Your daily responsibilities include designing and implementing agentic workflows using Retrieval-Augmented Generation, evaluating technical performance of AI solutions, and developing developer-focused content like tutorials and code samples. You will utilize Python, JavaScript, and C++ while working with frameworks such as vLLM, NVIDIA Triton Inference Server, and TensorRT. The role requires building scalable, production-ready inference systems optimized for Kubernetes deployment. You will solve complex problems in AI software architecture by creating technical whitepapers, running product demos, and collaborating across hardware and software engineering teams to improve product offerings.

What does a Systems Software Engineer earn in California?

Median $235750 from 32 postings across 3 companies.

See salary data

What you'll do

  • Evaluate cloud-native, full-stack applications using microservices architecture to power AI use cases.
  • Design and implement agentic workflows using Retrieval-Augmented Generation (RAG) and advanced AI models.
  • Analyze technical performance of AI solutions and compile findings into comprehensive reports.
  • Provide practical product improvement suggestions to senior executives and engineering management.
  • Develop developer-focused content including detailed tutorials and code samples for NVIDIA tools.
  • Write technical whitepapers and product briefs for the company.
  • Run technical demos of NVIDIA products at prominent industry conferences.

What we're looking for

  • A Bachelor’s or Master’s in Software Engineering, Computer Science, Computer Engineering, Electrical Engineering, or a related degree (or equivalent experience).
  • Proficiency in Python and JavaScript for programming and debugging.
  • Strong foundation in data structures, algorithms, and software design principles.
  • Basic familiarity with C++ programming and its application in high-performance computing environments.
  • Experience crafting cloud-native systems optimized for Kubernetes deployment using inference frameworks like vLLM and NVIDIA Triton Inference Server.
  • Solid understanding of API design principles for building scalable, production-ready inference systems.
  • Advanced knowledge of LLMs, modern AI software architecture, and cloud APIs (preferred).
  • Contributions to public-facing technical content and open-source projects (preferred).

More like this

Similar roles

Systems Software Engineer, AI and Cloud

Nvidia

Santa Clara, CA 10 days ago
Python JavaScript C++ Kubernetes vLLM NVIDIA Triton Inference Server TensorRT RAG LLMs Microservices Cloud-native API Design Data Structures Algorithms Software Design Principles High-Performance Computing
3+ yrs exp

Systems Software Engineer

Nvidia

Hillsboro, OR 10 days ago
CUDA GPU Deep Learning Distributed Computing Parallel Programming Algorithm Development Data Structures Memory Management Model Optimization Backpropagation semiconductor manufacturing Computational Geometry Low-level Performance Optimization

System Design Engineer

Nvidia

Santa Clara, CA 4 days ago $92,000–$155,250
PCB Design PCB Layout Linux Windows Oscilloscope Multimeter Logic Analyzer System Validation SoC GPU Tegra MGX Bringup

Software R&D Engineer, VLSI Physical Design

Nvidia

Austin, TX +1 81 days ago $116,000–$189,750
C++ VLSI Physical Design Machine Learning Python Perl Tcl ICC2 Innovus PrimeTime Tempus StarRC Distributed Computing Multithreading Reinforcement Learning Graph Neural Networks Parallel Computing EDA Tools

Software Quality Assurance Engineer

Nvidia

Santa Clara, CA 118 days ago
Python C# C++ VMware ESXi Citrix Hypervisor Microsoft Hyper-V KVM Windows Linux PowerShell Bash DirectX OpenGL WDDM CUDA OpenCL ETW Generative AI LLMs