Distinguished Engineer – High Performance AI

Nvidia

Actively hiring
Remote (Us, Ca, Santa Clara, US) Posted 133 days ago $320,000–$488,750 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Distinguished Engineer – High Performance AI on NVIDIA’s cutting-edge team, you will lead the development of agentic AI systems within the CUDA ecosystem. Your role involves setting technical direction and driving execution across the full stack, from multi-agent runtimes to GPU-accelerated inference stacks, while collaborating closely with internal teams to integrate new capabilities into production-ready solutions. You will develop evaluation frameworks for performance and quality, mentor senior talent, and influence key architectural decisions that enhance developer productivity and model efficiency. The ideal candidate has over 17 years of experience in AI systems development, strong C/C++ and Python programming skills, and a proven track record in GPU optimization and leading large-scale projects to production success.

Skills

CUDA Python C/C++ GPU programming Deep learning frameworks Reinforcement learning Multi-agent systems CI/CD Docker Kubernetes NVIDIA hardware Software engineering fundamentals Performance optimization Evaluation frameworks Open-source contributions Technical leadership Architecture design

What you'll do

  • Define and execute technical roadmaps for agentic AI systems in the CUDA ecosystem.
  • Develop high-fidelity evaluation frameworks to measure performance and quality of AI systems.
  • Drive architecture decisions across the entire AI stack from hardware to inference/serving.
  • Co-design advanced multi-agent systems with software, hardware, and algorithm teams.
  • Mentor senior technical talent and scale impact through leadership within the organization.

What we're looking for

  • Over 17 years of experience in AI systems development and foundational models.
  • Strong C/C++ and Python programming skills with solid software engineering fundamentals.
  • Extensive GPU programming expertise, including CUDA or equivalent performance optimization.
  • Proven leadership in large-scale cross-team projects from concept to production delivery.
  • Track record in building, evaluating deep learning models, and driving broad adoption.
  • Demonstrated ability to optimize high-performance models on resource-constrained platforms.

Market check

Salary context

This $320,000–$488,750 range sits above 99% of similar postings on FindRole.

Peer median band

$171,400–$261,300

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$165,852–$249,821

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 802 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 798 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Distinguished Engineer, Applied AI

GEICO

Ca Palo Alto Office, US 10 days ago $150,000–$300,000
Python Java C# AWS Microsoft AI/ML LLM-based systems Agentic frameworks Conversational AI Microservices REST APIs CI/CD Infrastructure as Code Salesforce Kubernetes Terraform PostgreSQL Docker Prometheus Grafana

Distinguished Engineer, AI Applications

GEICO

Remote (Ca Palo Alto Office, US) 44 days ago $210,000–$350,000
LangChain LlamaIndex Elasticsearch Qdrant Milvus Pinecone Weaviate Snowflake Kafka Spark Ray Airflow Temporal Prefect LangSmith Arize Phoenix Weights & Biases OpenTelemetry AWS Azure CI/CD Kubernetes
Remote

Distinguished AI Engineer

Capital One Financial

Cambridge, Ma, US 50 days ago $269,100–$307,200
Python Go Scala Java Cloud Platforms AI Systems ML Algorithms Scalable Solutions Complex AI Systems Responsible AI CI/CD

Distinguished AI Engineer

Capital One Financial

Mclean, Va, US 23 days ago $269,100–$307,200
Python Go Scala Java AWS Kubernetes CI/CD

Distinguished Engineer – AI Security

CVS Health

Remote (Scottsdale-9501 East Shea Blvd, US) 69 days ago $175,100–$334,750
MITRE_ATLAS NIST_RMF ISACA_AI_Audit_Toolkit ISO_IEC_AI_security_standards Transformer_based_NLP LLM_based_generative_AI Agentic_AI Zero_Trust_architecture CI_CD HIPAA GDPR Privacy_enhancing_technologies Secure_data_handling_patterns AI_risk_management_frameworks Adversarial_ML Secure_model_deployment AI_agent_authorization AI_data_loss_protection AI_safety
Remote

Senior Distinguished AI Engineer

Capital One Financial

San Francisco, Ca, US 64 days ago $314,800–$359,300
Python Go Scala Java CI/CD AWS Kubernetes Terraform Docker Prometheus Grafana