Principal Engineer, Local AI - Agents and Systems

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CARedmond, WA
Salary
$272,000–$431,250 / yr
Posted
46 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $216k
This role $352k
$133k most similar roles pay here $463k

This role pays more than 98% of similar roles. Most pay $184,975–$246,150 — the shaded band above. At the midpoint, this role pays about $352k versus about $216k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Engineer, Local AI - Agents and Systems

Principal Engineer, Local AI - Agents and Systems will lead technical efforts to develop advanced AI agent frameworks and local runtimes on Windows environments for GeForce RTX GPUs. This role involves building the technical roadmap for self-evolving assistants, optimizing agent runtimes, and ensuring autonomous agents operate within policy-based privacy and security frameworks including filesystem access and secure inference routing. The position requires expertise in Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture. Key technical requirements include experience with LLM inference pipelines like Ollama, Llama.cpp, and vLLM; GPU-accelerated computing using CUDA and TensorRT; and orchestration frameworks such as OpenClaw, Hermes, and LangChain. The candidate must be proficient in C++ for performance-critical systems and Python for AI logic while developing the foundation of a desktop AI operating system.

What does a Engineer earn in California?

Median $208000 from 94 postings across 22 companies.

See salary data

What you'll do

  • Lead the development of agent frameworks natively for Windows environments.
  • Build a technical roadmap to deploy autonomous AI assistants on GeForce RTX hardware.
  • Optimize agent runtimes specifically for Windows and consumer-grade GPUs.
  • Implement policy-based privacy and security frameworks for filesystem access and network egress.
  • Develop secure inference routing and sandboxed execution environments for local models.
  • Integrate open-source AI agents into the desktop ecosystem using local inference pipelines.
  • Mentor other engineers and establish technical guidelines for AI agent deployment.
  • Write production-ready code in C++ and Python to support system-level integrations.

What we're looking for

  • 15+ years of relevant professional software engineering experience.
  • At least 3+ years in a Staff or Lead Architect role.
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field.
  • Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
  • Proven understanding of LLM inference pipelines, GPU-accelerated computing (CUDA, TensorRT), and running local models on consumer hardware.
  • Practical experience with modern AI orchestration and agentic frameworks like OpenClaw, Hermes, or LangChain.
  • Proficiency in C++ for performance-critical systems and Python for AI/blueprint logic.
  • Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.

More like this

Similar roles

Senior Engineer, Local AI - Agents and Systems

Nvidia

Santa Clara, CA +1 49 days ago $184,000$287,500
C++ Python CUDA TensorRT Ollama Llama.cpp vLLM LangChain Windows OS Sandboxing Containerization Virtualization LLM Inference Multi-agent Systems NVIDIA GeForce RTX OpenClaw Hermes
10+ yrs exp

Principal AI Engineer

CNA Financial

Chicago, IL 65 days ago $97,000$189,000
AI Engineering Agentic Workflows LLM Context Engineering Multi-agent Orchestration MCP Protocol CI/CD GitHub Actions Terraform Kubernetes GKE GCP GitHub JFrog Artifactory Application Security infrastructure-as-code
9+ yrs exp Hybrid

Principal AI Engineer

Humana

New York, NY +2 18 days ago $206,600$284,300
LLMs RAG Python TypeScript JavaScript React Next.js PostgreSQL Vertex AI Gemini Docker Kubernetes CI/CD Agentic Workflows Model Context Protocol (MCP) OCR Document AI Distributed Systems Cloud-native Architecture
10+ yrs exp Hybrid

Principal AI Engineer

CNA Financial

Chicago, IL 65 days ago $97,000$189,000
AI Engineering Agentic Workflows LLM Context Engineering CI/CD Terraform Kubernetes GKE GCP GitHub Actions Claude Code Cursor GitHub Copilot MCP Protocol infrastructure-as-code Artifact Management JFrog Artifactory Application Security
9+ yrs exp Hybrid