Lead AI Engineer

Capital One Financial

Confirmed live yesterday Low trust

Quick summary

Work type
On-site
Location
New York, NYSan Francisco, CAMcLean, VACambridge, MASan Jose, CA
Salary
$197,300–$225,100 / yr
Posted
142 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $210k
This role $211k
$164k most similar roles pay here $255k

This role pays more than 66% of similar roles. Most pay $172,900–$246,150 — the shaded band above. At the midpoint, this role pays about $211k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 998 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 992 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Lead AI Engineer

Lead AI Engineer As part of the Intelligent Foundations and Experiences team, you will partner with cross-functional teams of engineers, research scientists, and product managers to develop AI-powered products that enhance internal workflows and customer interactions. You will design, develop, test, deploy, and support critical software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, and observability. To achieve these goals, you will utilize a technical stack featuring PyTorch, Huggingface, VectorDBs, Nemo Guardrails, and AWS Ultraclusters while implementing optimization techniques to improve performance metrics like latency, throughput, and cost for large-scale production systems. You will work within the banking domain to build responsible, scalable AI infrastructure and proprietary solutions that provide high-leverage impact. Required skills include proficiency in Python, Go, Scala, or Java, along with a strong foundation in engineering and mathematics.

What you'll do

  • Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
  • Implement similarity search, guardrails, model evaluation, and observability for production AI systems.
  • Develop state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput.
  • Utilize a broad stack of open-source and SaaS technologies including Huggingface, VectorDBs, and PyTorch.
  • Contribute to the technical vision and long-term roadmap of foundational AI systems.
  • Translate complex scientific research into practical, high-performance production features for banking products.

What we're looking for

  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms.
  • Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI and ML algorithms.
  • At least 4 years of experience programming with Python, Go, Scala, or Java.
  • Experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, or Azure.
  • Experience designing, developing, delivering, and supporting AI services including LLM inference, similarity search, and vector databases.
  • Experience applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost.
  • Ability to interpret scientific publications and apply novel research techniques in production environments.
  • Strong foundation in engineering and mathematics to identify and exploit optimization opportunities in hardware and software.

More like this

Similar roles

Lead AI Engineer

Capital One Financial

New York, NY +4 55 days ago $179,400$204,700
Python Go Scala Java C++ C# AWS Huggingface PyTorch VectorDBs LLM Inference Similarity Search Nemo Guardrails Machine Learning Model Evaluation Observability
4+ yrs exp

Lead AI Engineer

Capital One Financial

McLean, VA +3 39 days ago $197,300$225,100
Python Go Scala Java C++ C# AWS Huggingface PyTorch VectorDBs LLM Inference Machine Learning Nemo Guardrails Similarity Search SaaS
4+ yrs exp

Lead AI Engineer

Capital One Financial

McLean, VA +3 45 days ago $197,300$225,100
Python Go Scala Java C++ C# AWS Huggingface PyTorch VectorDBs LLM Inference Nemo Guardrails Machine Learning Similarity Search SaaS AI Technologies
4+ yrs exp

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 142 days ago $229,900$262,400
Python Go Scala Java C++ C# PyTorch Huggingface AWS VectorDBs LLM Inference Machine Learning Nemo Guardrails Similarity Search
6+ yrs exp

Lead AI Engineer

Capital One Financial

New York, NY +4 21 days ago $197,300$225,100
LLM Python PyTorch Huggingface AWS VectorDBs Nemo Guardrails Go Scala Java C++ C# Machine Learning Similarity Search Model Inference SaaS
4+ yrs exp