Senior Software Engineer, AI Infrastructure Solutions

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$152,000–$241,500 / yr
Employment
Full-time
Posted
5 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $187k
This role $197k
$124k $254k
below market most similar roles pay here above market

This role pays more than 62% of similar roles. Most pay $144,350–$230,162 — the blue band above. At the midpoint, this role pays about $197k versus about $187k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, AI Infrastructure Solutions

As a Senior Software Engineer, AI Infrastructure Solutions, you will join the Modular Diagnostics team to develop key diagnostic applications and infrastructure for testing every NVIDIA GPU. You will build and deliver agentic AI solutions, including autonomous systems that reason, plan, and take actions to automate silicon bring-up, test and validation frameworks, debugging, and engineering workflows. Your daily work involves building scalable AI infrastructure, services, APIs, and reusable platforms while integrating AI agents with knowledge bases and data platforms. You must possess strong programming skills in Python and C/C++ and experience with large language models, retrieval-augmented generation, and workflow orchestration. This role solves the technical challenge of improving GPU validation speed and quality by establishing evaluation, observability, security, and reliability practices for production-ready AI systems.

What does a Software Engineer earn in California?

Median $214500 from 1193 postings across 76 companies.

See salary data

What you'll do

  • Build and deliver agentic AI solutions that reason, plan, and take actions to automate engineering workflows.
  • Develop scalable AI infrastructure, services, APIs, and reusable platforms for company-wide AI application deployment.
  • Integrate AI agents with engineering tools, knowledge bases, and data platforms to create end-to-end intelligent workflows.
  • Partner with multi-functional teams to identify high-impact use cases and develop production-ready prototypes.
  • Establish evaluation, observability, security, and reliability practices for AI systems to ensure enterprise-grade performance.
  • Drive projects from initial concept through production adoption while measuring impact against success criteria.
  • Automate silicon bring-up, test and validation frameworks, and debugging processes to accelerate GPU launches.

What we're looking for

  • BS or MS degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
  • 5+ years of experience delivering production software, infrastructure, platform, or AI solutions.
  • Strong programming skills in Python and C/C++.
  • Track record of building applications with large language models, AI agents, retrieval-augmented generation, tool use, or workflow orchestration.
  • Demonstrated ability to build scalable services, APIs, data pipelines, and production software infrastructure.
  • Strong problem-solving, debugging, and system-design skills with a history of shipping reliable systems.
  • Background in GPU computing, CUDA, GPU architecture, or silicon bring-up processes (preferred).
  • Familiarity with engineering diagnostics, hardware development workflows, or systems software (preferred).

More like this

Similar roles

Senior AI Infrastructure Engineer

Anduril Industries

Costa Mesa, CA +2 33 days ago $191,000–$253,000
Python Go C++ PyTorch Distributed Ray Slurm Megatron-LM Docker Kubernetes MLOps CI/CD LLMs Reinforcement Learning RLHF DPO Computer Vision SLAM ETL GovCloud
5+ yrs exp

Software Engineer, AI Infrastructure

Apple Inc

Cupertino, CA 102 days ago $184,700–$324,800
Python Go Distributed Systems Cloud Services LLMs AI Infrastructure Security Architecture Observability Backend Programming Cost Controls Load Shaping
5+ yrs exp

Senior Core Infrastructure Engineer, AI Infrastructure

Oracle

Nashville, TN 42 days ago $79,200–$209,500
OCI Python Java C C++ GoLang Shell Scripting Linux SQL MySQL Redis Memcache RoCE Infiniband Infrastructure as Code Distributed Systems System Design Fault Tolerance Telemetry Systems
4+ yrs exp

AI Infrastructure Software Engineer

Qualcomm

San Diego, CA 40 days ago $99,500–$149,300
C C++ Python Java RTOS Embedded Systems Linux Android Windows IPC Memory Management DSP Machine Learning Computer Architecture Concurrency