Senior Engineer, Local AI - Agents and Systems

Nvidia

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Santa Clara, CARedmond, WA
Salary: $184,000–$287,500 / yr
Employment: Full-time
Posted: 95 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $204k

This role $236k

$136k $304k

below market most similar roles pay here above market

This role pays more than 73% of similar roles. Most pay $162,000–$245,625 — the blue band above. At the midpoint, this role pays about $236k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Engineer, Local AI - Agents and Systems

Role Posting Log in to save

JOB TITLE: Senior Engineer, Local AI - Agents and Systems As a Senior Engineer, you will lead technical efforts to deploy advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. You will build the technical roadmap and optimize agent runtimes to enable always-on, self-evolving AI assistants to operate locally on consumer PCs. Your daily work involves ensuring autonomous agents function within policy-based privacy and security frameworks, including filesystem access, secure inference routing, and network egress. You will utilize C++, Python, CUDA, TensorRT, Ollama, Llama.cpp, and vLLM to develop these systems. Key responsibilities include mentoring engineers, writing production-ready code, and integrating multi-agent systems like OpenClaw, Hermes, and LangChain. This role solves the challenge of providing secure, sandboxed execution for local inference on desktop hardware.

What does a Engineer earn in California?

Median $199500 from 103 postings across 31 companies.

See salary data

Skills

C++ Python CUDA TensorRT Windows OS LLM Inference LangChain Ollama Llama.cpp vLLM Sandboxing Virtualization Containerization Multi-agent Systems GPU-accelerated computing OpenClaw Hermes

What you'll do

Lead the development of native AI agent frameworks for Windows environments.
Build the technical roadmap for deploying self-evolving AI assistants on GeForce RTX hardware.
Optimize agent runtimes to ensure efficient performance on consumer PCs and laptops.
Implement policy-based privacy and security frameworks for filesystem access and network egress.
Develop secure inference routing and sandboxed execution environments for local AI models.
Write production-ready code to integrate AI agents with Windows OS internals.
Establish technical guidelines and best practices for AI agent deployment.

What we're looking for

10+ years of relevant professional software engineering experience.
At least 3+ years of experience in a Staff or Lead Architect role.
BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field (or equivalent experience).
Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
Proven understanding of LLM inference pipelines, GPU-accelerated computing (CUDA, TensorRT), and running local models on consumer-grade hardware.
Practical experience with modern AI orchestration and agentic frameworks.
Proficiency in C++ for performance-critical systems and Python for AI logic.
Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.

Save