Senior Engineer, Local AI - Agents and Systems

Nvidia

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Santa Clara, CARedmond, WA
Salary
$184,000–$287,500 / yr
Posted
50 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $206k
This role $236k
$151k most similar roles pay here $302k

This role pays more than 67% of similar roles. Most pay $165,750–$246,150 — the shaded band above. At the midpoint, this role pays about $236k versus about $206k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Engineer, Local AI - Agents and Systems

As a Senior Engineer, Local AI - Agents and Systems, you will lead technical efforts to develop advanced AI agent frameworks and local runtimes on Windows environments for GeForce RTX GPUs. You will build the technical roadmap to bring self-evolving AI assistants to consumer PCs while ensuring they operate within policy-based privacy and security frameworks involving filesystem access and secure inference routing. Your daily work involves optimizing agent runtimes, mentoring other engineers, and writing production-ready code in C++ and Python. The role requires expertise in Windows OS internals, sandboxing technologies, and LLM inference pipelines such as Ollama, Llama.cpp, and vLLM. You will also utilize CUDA, TensorRT, and orchestration frameworks like OpenClaw, Hermes, or LangChain to solve the challenge of running autonomous multi-agent systems safely on local hardware.

What does a Engineer earn in California?

Median $208000 from 94 postings across 22 companies.

See salary data

What you'll do

  • Lead the development of agent frameworks natively on Windows environments.
  • Build a technical roadmap for deploying self-evolving AI assistants on GeForce RTX hardware.
  • Optimize agent runtimes specifically for Windows and consumer-grade GPU systems.
  • Implement policy-based privacy and security frameworks for filesystem access and network egress.
  • Develop secure inference routing and sandboxed execution environments for local AI models.
  • Integrate open-source AI agents into the desktop ecosystem using advanced orchestration frameworks.
  • Mentor other engineers and establish technical guidelines for AI agent deployment.
  • Write production-ready code in C++ and Python to integrate systems with AI logic.

What we're looking for

  • 10+ years of relevant professional software engineering experience.
  • At least 3+ years in a Staff or Lead Architect role.
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field.
  • Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
  • Proven understanding of LLM inference pipelines, GPU-accelerated computing (CUDA, TensorRT), and running local models on consumer hardware.
  • Practical experience with modern AI orchestration and agentic frameworks like OpenClaw, Hermes, or LangChain.
  • Proficiency in C++ for performance-critical systems and Python for AI/blueprint logic.
  • Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.

More like this

Similar roles

Principal Engineer, Local AI - Agents and Systems

Nvidia

Santa Clara, CA +1 47 days ago $272,000$431,250
Windows C++ Python CUDA TensorRT Ollama Llama.cpp vLLM LangChain Sandboxing Containerization Virtualization LLM Inference Multi-agent Systems NVIDIA GeForce RTX Nemotron OpenClaw
10+ yrs exp

Senior AI Agent Engineer

F5 Inc

Remote 73 days ago $192,000$288,000
Python TypeScript Java LLM Prompt Engineering LangChain CrewAI AutoGen Microsoft Copilot Studio Google Gemini OpenAI API Anthropic API Google AI Studio Salesforce HubSpot Marketo Adobe Suite Tableau ServiceNow
5+ yrs exp Remote

Senior AI Agent Engineer

Oracle

38 days ago $89,200$209,500
LLM AI Agents SQL Workflow Automation Structured Outputs Regression Testing Software Engineering Validation Logic Analytics
6+ yrs exp