Principal Engineer, Local AI - Agents and Systems

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CARedmond, WA
Salary
$272,000–$431,250 / yr
Employment
Full-time
Posted
92 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $215k
This role $352k
$116k $465k
below market most similar roles pay here above market

This role pays more than 98% of similar roles. Most pay $174,500–$255,062 — the blue band above. At the midpoint, this role pays about $352k versus about $215k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Engineer, Local AI - Agents and Systems

JOB TITLE: Principal Engineer, Local AI - Agents and Systems As the Principal Engineer for Local AI - Agents and Systems, you will lead technical efforts to deploy advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. You will build the technical roadmap for always-on, self-evolving AI assistants, ensuring they operate within policy-based privacy and security frameworks including filesystem access and secure inference routing. Your daily work involves optimizing agent runtimes, developing sandboxed execution environments, and partnering with research and driver teams. You must utilize C++, Python, CUDA, and TensorRT while working with LLM inference pipelines like Ollama, Llama.cpp, and vLLM. You will also leverage orchestration frameworks such as OpenClaw, Hermes, and LangChain to solve the problem of running autonomous agents safely on consumer-grade hardware.

What does a Engineer earn in California?

Median $199500 from 103 postings across 31 companies.

See salary data

What you'll do

  • Lead the development of native AI agent frameworks for Windows environments.
  • Build a technical roadmap for deploying self-evolving AI assistants on GeForce RTX hardware.
  • Optimize agent runtimes to ensure efficient performance on consumer PCs and laptops.
  • Implement policy-based privacy and security frameworks for filesystem access and network egress.
  • Develop secure inference routing and sandboxed execution environments for local AI models.
  • Write production-ready code in C++ and Python for performance-critical systems and AI logic.
  • Establish engineering guidelines for AI agent deployment and mentor other engineers.

What we're looking for

  • 15+ years of relevant professional software engineering experience.
  • At least 3+ years of experience in a Staff or Lead Architect role.
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field (or equivalent experience).
  • Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
  • Proven understanding of LLM inference pipelines, GPU-accelerated computing (CUDA, TensorRT), and running local models on consumer-grade hardware.
  • Practical experience with modern AI orchestration and agentic frameworks and multi-agent systems.
  • Proficiency in C++ for performance-critical systems and Python for AI/blueprint logic.
  • Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.

More like this

Similar roles

Senior Engineer, Local AI - Agents and Systems

Nvidia

Santa Clara, CA +1 95 days ago $184,000–$287,500
C++ Python CUDA TensorRT Windows OS LLM Inference LangChain Ollama Llama.cpp vLLM Sandboxing Virtualization Containerization Multi-agent Systems GPU-accelerated computing OpenClaw Hermes
10+ yrs exp

Senior Engineer, Local AI - Agents and Systems

Nvidia

Santa Clara, CA +1 28 days ago $184,000–$287,500
C++ Python CUDA TensorRT Windows OS LLM Inference LangChain Ollama Llama.cpp vLLM Sandboxing Virtualization Containerization Multi-agent Systems GPU-accelerated computing OpenClaw Hermes
10+ yrs exp

Senior High Performance AI Engineer, Agentic AI

Nvidia

Remote (Santa Clara, CA) +5 46 days ago
CUDA Python C++ Rust Deep Learning Reinforcement Learning TRT-LLM SGLang vLLM Transformer Engine GPU Programming High-Performance Computing Compilers Inference Systems Agentic AI Multi-Agent Systems
4+ yrs exp Remote

Principal AI/Agentic Engineer

Abbott

Abbott Park, IL 14 days ago $149,300–$298,700
Python TypeScript Go Java LangGraph Temporal LLM Agentic Systems CI/CD Distributed Systems API Design Retrieval Observability Secure SDLC Shadow Evaluation HIPAA GxP
10+ yrs exp

Principal Engineer, Agent Platform

Gap Inc

San Francisco, CA +1 21 days ago
Python LLM Generative AI Vertex AI Gemini GKE Cloud Run BigQuery Pub/Sub Distributed Systems Vector Search OAuth Policy-as-Code Observability Orchestration

Principal AI Engineer

Humana

New York, NY +2 36 days ago $206,600–$284,300
Python TypeScript JavaScript React Next.js PostgreSQL Gemini Vertex AI OCR Document AI Docker Kubernetes CI/CD RAG LLM Agentic Workflows Model Context Protocol (MCP) Distributed Systems Cloud-native Architecture
10+ yrs exp Hybrid