Director, AI Engineering

Capital One Financial

Confirmed live today Low trust
Remote

Quick summary

Work type
Remote
Location
McLean, VASan Francisco, CANew York, NY
Employment
Full-time
Posted
50 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $254k
$187k $320k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $219,075–$288,150.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 2204 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1138 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Director, AI Engineering

JOB TITLE: Director, AI Engineering (Remote - eligible) The Director, AI Engineering joins the Intelligent Foundations and Experiences team to lead the development of a governed infrastructure layer between applications and foundation models. You will oversee the design, testing, and deployment of AI software components, including foundation model training, large language model inference, similarity search, and guardrails. Key responsibilities involve making build-vs-buy decisions and inventing LLM optimization techniques to improve scalability, cost, and latency for production systems. You will utilize a technical stack including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch. This role solves the business problem of creating a centralized, reliable, and secure interface for enterprise-wide AI adoption, ensuring that model routing, observability, and cost management are handled efficiently across all company products.

What you'll do

  • Oversee the design, development, testing, deployment, and support of AI software components including LLM inference and model evaluation.
  • Make high-judgment build-vs-buy decisions regarding open-source and SaaS AI technologies like AWS Ultraclusters and VectorDBs.
  • Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production systems.
  • Contribute to the technical vision and long-term roadmap of foundational AI systems.
  • Manage the infrastructure layer for model access, routing, reliability, security integration, observability, and cost management.
  • Attract, retain, and nurture the professional development of top AI engineering talent.
  • Partner with cross-functional teams to deliver AI-powered products that improve associate workflows and customer interactions.

What we're looking for

  • Bachelor's degree in Computer Science, Engineering, or AI plus 8 years of experience developing or leading AI and ML algorithms or technologies.
  • Master's degree plus 6 years of experience developing or leading AI and ML algorithms or technologies.
  • At least 3 years of people leadership experience.
  • 5 years of experience managing and leading an engineering team (preferred).
  • 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
  • Master's degree in Computer Science, Computer Engineering, or a relevant technical field (preferred).
  • Ability to stay up to date with latest AI research and apply novel techniques in production (preferred).
  • Excellent communication and presentation skills to articulate complex AI concepts to peers (preferred).

More like this

Similar roles

Senior Director, AI Engineering, Agentic AI Platform

Capital One Financial

Remote (San Francisco, CA) +4 101 days ago
LLM PyTorch AWS VectorDB Huggingface Nemo Guardrails Similarity Search Model Evaluation Observability Machine Learning Google Cloud Azure
10+ yrs exp Remote

Senior Director, AI Engineering

Capital One Financial

San Francisco, CA +5 65 days ago
Machine Learning Python PyTorch AWS Huggingface VectorDBs Nemo Guardrails C++ C# Java Golang Similarity Search LLM Inference Observability
10+ yrs exp

Director, AI Engineering

Capital One Financial

Remote (McLean, VA) +2 22 days ago $244,700–$279,200
Python C++ C# Java CUDA Golang PyTorch Huggingface AWS Google Cloud Azure VectorDBs LLM Inference Similarity Search Observability Responsible AI
8+ yrs exp Remote

Director, AI Engineer

Capital One Financial

Remote (San Francisco, CA) +5 36 days ago $244,700–$279,200
Python C++ Java CUDA Golang PyTorch Huggingface AWS Google Cloud Azure VectorDBs LLM Inference Similarity Search Agentic AI Observability Governance Responsible AI
8+ yrs exp Remote

Director AI Engineer

Capital One Financial

San Jose, CA +4 4 days ago $269,100–$307,200
LLM Inference VectorDBs PyTorch Python CUDA Huggingface AWS Google Cloud Azure C++ Java C# Golang Similarity Search Agentic AI Observability Model Evaluation Responsible AI
8+ yrs exp

Senior Distinguished AI Engineer

Capital One Financial

Remote (San Francisco, CA) +4 122 days ago
Python Go Scala Java C++ C# PyTorch Huggingface AWS Google Cloud Azure VectorDBs Nemo Guardrails LLM Inference Similarity Search Computer Vision Speech Recognition Optical Character Recognition
10+ yrs exp Remote