Director, AI Engineering

Capital One Financial

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
McLean, VANew York, NYSan Francisco, CA
Salary
$244,700–$279,200 / yr
Posted
3 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $256k
This role $262k
$187k most similar roles pay here $320k

This role pays more than 56% of similar roles. Most pay $222,500–$290,250 — the shaded band above. At the midpoint, this role pays about $262k versus about $256k for comparable roles.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 1042 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1036 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Director, AI Engineering

Director, AI Engineering joins the Intelligent Foundations and Experiences team to develop responsible, scalable AI infrastructure for banking services. This role involves overseeing the design, development, testing, and deployment of critical software components including foundation model training, large language model inference, similarity search, guardrails, and observability. You will manage a cross-functional team of engineers and scientists while making high judgment build-vs-buy decisions across a stack featuring PyTorch, Huggingface, VectorDBs, Nemo Guardrails, and AWS Ultraclusters. The position focuses on building the infrastructure layer between applications and foundation models to optimize for latency, reliability, and cost efficiency. You will implement state-of-the-art LLM optimization techniques and manage the technical roadmap for foundational systems. The work addresses the challenge of providing a governed interface for model access while ensuring high performance in production environments.

What you'll do

  • Oversee the design, development, testing, deployment, and support of AI software components including LLM inference and model evaluation.
  • Make high-judgment build-vs-buy decisions regarding open-source and SaaS AI technologies like Huggingface, VectorDBs, and PyTorch.
  • Implement state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput for production systems.
  • Define the technical vision and long-term roadmap for foundational AI systems across the enterprise.
  • Manage the infrastructure layer between applications and foundation models, including routing, reliability, security, and cost management.
  • Attract, retain, and mentor top talent in the AI industry while fostering a culture of continuous learning.
  • Partner with cross-functional teams to deliver AI-powered products that improve internal workflows and customer experiences.

What we're looking for

  • Bachelor's degree in Computer Science, Engineering, or AI plus 8 years of experience developing or leading AI/ML technologies.
  • Master's degree plus at least 6 years of experience developing or leading AI and ML algorithms or technologies.
  • At least 3 years of people leadership experience.
  • 5 years of experience managing and leading an engineering team (preferred).
  • 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
  • Master's degree in Computer Science, Computer Engineering, or a relevant technical field (preferred).
  • Ability to stay updated on AI research and apply novel techniques in production (preferred).
  • Excellent communication skills to articulate complex AI concepts to peers (preferred).

More like this

Similar roles

Senior Director, AI Engineering Agentic AI Platform

Capital One Financial

Remote (San Francisco, CA) +3 54 days ago $286,200$326,700
LLM PyTorch Huggingface AWS VectorDBs Nemo Guardrails Machine Learning AI Engineering Similarity Search Model Evaluation Observability SaaS Open Source Mathematics
10+ yrs exp Remote

Senior Director, AI Engineering

Capital One Financial

San Francisco, CA +4 18 days ago $286,200$326,700
Machine Learning Python PyTorch Huggingface AWS VectorDBs Nemo Guardrails C++ C# Java Golang Similarity Search LLM Inference Open Source SaaS
10+ yrs exp

Senior Director, AI Engineering Agentic AI Platform

Capital One Financial

Remote (San Jose, CA) 5 days ago $343,400$392,000
Agentic AI LLM Machine Learning PyTorch Huggingface VectorDBs Nemo Guardrails AWS Model Evaluation Similarity Search AI Infrastructure SaaS Open Source
10+ yrs exp Remote

Senior Distinguished AI Engineer

Capital One Financial

Remote (San Francisco, CA) +3 75 days ago $286,200$326,700
Machine Learning LLM PyTorch Python Go Scala Java C++ C# AWS Huggingface VectorDBs Nemo Guardrails Similarity Search Computer Vision Speech Recognition Optical Character Recognition
10+ yrs exp Remote

Lead AI Engineer

Capital One Financial

New York, NY +4 24 days ago $197,300$225,100
LLM Python PyTorch Huggingface AWS VectorDBs Nemo Guardrails Go Scala Java C++ C# Machine Learning Similarity Search Model Inference SaaS
4+ yrs exp

Senior Staff AI Engineer

Capital One Financial

San Francisco, CA +4 13 days ago $314,800$359,300
Machine Learning Python Go Scala Java C++ C# AWS Huggingface PyTorch VectorDBs Nemo Guardrails LLM Inference Similarity Search Model Evaluation Observability
10+ yrs exp