Senior Director, AI Engineering, Agentic AI Platform

Capital One Financial

Confirmed live yesterday Low trust

Remote

Quick summary

Work type: Remote
Location: San Jose, CA
Employment: Full-time
Posted: 50 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $230k

$163k $300k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $179,475–$281,262.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 2164 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1129 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Senior Director, AI Engineering, Agentic AI Platform

Role Posting Log in to save

The Senior Director, AI Engineering -Agentic AI Platform joins the Intelligent Foundations and Experiences team to lead the development of responsible, scalable AI systems. This role involves overseeing the design, development, testing, and deployment of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. You will make high-judgment build-vs-buy decisions and invent state-of-the-art LLM optimization techniques to improve performance, cost, latency, and throughput. Key technologies include AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch. The work focuses on building proprietary solutions and high-performance AI infrastructure to deliver breakthrough product experiences, specifically solving the technical challenges of deploying large-scale production AI systems while ensuring they are reliable and secure for banking applications.

Skills

LLM Inference VectorDBs PyTorch AWS Huggingface Nemo Guardrails Similarity Search Machine Learning AI Engineering Model Evaluation Observability Guardrails Foundation Model Training SaaS AI Technologies

What you'll do

Oversee the design, development, testing, deployment, and support of AI software components including LLM inference and guardrails.
Make high-judgment build-vs-buy decisions regarding open-source and SaaS AI technologies like AWS Ultraclusters and VectorDBs.
Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, and latency.
Contribute to the technical vision and long-term roadmap of foundational AI systems.
Attract, retain, and nurture the professional development of top AI engineering talent.
Partner with cross-functional teams to deliver AI-powered products that improve associate workflows and customer interactions.
Apply novel techniques from scientific publications to production environments to solve complex, undefined problems.

What we're looking for

Bachelor's degree in Computer Science, Engineering, or AI plus 10 years of experience developing or leading AI and ML algorithms or technologies.
Master's degree plus 8 years of experience developing or leading AI and ML algorithms or technologies.
At least 5 years of people leadership experience.
7 years of experience managing and leading an engineering team (preferred).
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
Experience developing AI and ML algorithms such as LLM Inference, Similarity Search, VectorDBs, Guardrails, and Memory (preferred).
Master's degree in Computer Science, Computer Engineering, or a relevant technical field (preferred).
Excellent communication and presentation skills to articulate complex AI concepts to peers (preferred).

Save