Senior Software Engineer, Agent Performance Modeling

Nvidia

Confirmed live today High trust

Hybrid

Quick summary

Work type: Hybrid
Location: Santa Clara, CA
Salary: $152,000–$241,500 / yr
Employment: Full-time
Posted: 18 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $202k

This role $197k

$141k $252k

below market most similar roles pay here above market

This role pays more than 51% of similar roles. Most pay $167,500–$235,750 — the blue band above. At the midpoint, this role pays about $197k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, Agent Performance Modeling

Role Posting Log in to save

As a Senior Software Engineer, Agent Performance Modeling, you will join a team that combines simulation and agentic engineering to understand emerging LLM architectures and inform hardware and software decisions. Your primary responsibilities include building and validating performance models for LLM architectures across GPU, LPU, and heterogeneous systems. You will develop agents to automate simulation workflows, analyze bottlenecks, and accelerate design space exploration while collaborating with hardware architecture, inference, runtime, and compiler teams. The role requires proficiency in modern LLM architectures, simulation, profiling, and roofline analysis for LLM inference. You must possess strong software engineering skills to build reliable engineering tools using coding agents like Claude Code or Codex. This position focuses on mapping evolving inference workloads to hardware to design efficient AI systems.

What does a Software Engineer earn in California?

Median $214500 from 1193 postings across 76 companies.

See salary data

Skills

LLM Architectures Performance Modeling Simulation Inference Optimization GPU LPU Heterogeneous Systems Roofline Analysis Agentic Engineering Coding Agents Claude Code Codex Compiler Hardware Architecture Profiling

What you'll do

Build and validate performance models for LLM architectures across GPU, LPU, and heterogeneous systems.
Develop agents to automate simulation workflows and analyze performance bottlenecks.
Accelerate design space exploration for emerging AI architectures.
Collaborate with hardware, inference, runtime, and compiler teams to improve modeling accuracy.
Guide hardware and software optimization decisions based on simulation results.
Build reliable engineering tools using coding agents like Claude Code and Codex.

What we're looking for

MS in Computer Science or a related field.
5+ years of experience in a relevant field.
Familiarity with modern LLM architectures and their inference characteristics.
Experience with simulation, profiling, or performance modeling, including roofline analysis for LLM inference.
Strong software engineering skills and experience building reliable engineering tools using coding agents.
Strong analytical skills and a rigorous approach to experimentation and validation.
Experience building agents that automate complex engineering workflows (preferred).
Knowledge of accelerator architecture and compute, memory, or communication bottlenecks (preferred).

Similar roles

Senior High Performance AI Engineer, Agentic AI

Nvidia

Remote (Santa Clara, CA) +5 46 days ago

CUDA Python C++ Rust Deep Learning Reinforcement Learning TRT-LLM SGLang vLLM Transformer Engine GPU Programming High-Performance Computing Compilers Inference Systems Agentic AI Multi-Agent Systems

4+ yrs exp Remote

Save

Software Engineer, Agent Performance Modeling

Nvidia

Santa Clara, CA 7 days ago $124,000–$195,500

LLM Architectures Inference Optimization Performance Modeling Simulation Agentic Engineering GPU LPU Roofline Analysis Accelerator Architecture Compiler Profiling Heterogeneous Systems Hardware Architecture

Save

Senior AI Application Developer, GPU and SOC Architecture Modeling

Nvidia

Santa Clara, CA 12 days ago $152,000–$241,500

Python C++ LLMs LangChain LangSmith Claude Agent SDK Nemo Agent Toolkit GenAI Computer Architecture ML Frameworks GPT Claude Llama Multimodal Models GPU SOC Automated Workflows

5+ yrs exp

Save

Senior Software Engineer, AI Agent Platform

GEICO

Palo Alto, CA +3 27 days ago $105,000–$230,000

Python Java Go Distributed Systems GenAI RAG Kubernetes CI/CD Kafka AWS Azure OpenSearch Prometheus Grafana OpenTelemetry LangGraph Langfuse LangSmith Braintrust Arize Phoenix MCP SRE

5+ yrs exp

Save

Senior Software Engineer, AI Agent Platform

GEICO

Palo Alto, CA +3 27 days ago $105,000–$230,000

Python Java Go Kubernetes AWS Azure CI/CD RAG GenAI Kafka OpenSearch Prometheus Grafana OpenTelemetry LangGraph Temporal Restate Datadog Langfuse LangSmith Braintrust Arize Phoenix Distributed Systems API Design SRE

5+ yrs exp

Save

Senior Software Engineer, Agentic AI

Nvidia

Remote (Santa Clara, CA) +2 25 days ago $184,000–$287,500

Python Rust Go Node.js LLM RAG Vector Databases PyO3 Tokio serde OpenTelemetry Asynchronous Programming API Design Serialization Middleware

Remote

Save