This role pays more than
85%
of similar roles. Most pay
$158,050–$246,150
— the shaded band above.
At the midpoint, this role pays about
$246k
versus about
$202k
for comparable roles.
Based on 240 similar postings.
Employer
About Capital One Financial
Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking
Capital One Financial currently has
878 open roles
on FindRole.
Listed pay typically runs
$197,300–$225,100
across 872 roles with salary data.
AI Engineer 5 (Gen AI Platform Services) joins the Intelligent Foundations and Experiences team to develop and deploy proprietary AI solutions that enhance products for millions of customers. This role involves designing, testing, and supporting software components including foundation model training, large language model inference, multi-agent workflows, similarity search, guardrails, and observability. The engineer will optimize performance metrics like scalability, cost, latency, and throughput while leading cost-performance governance reviews and mentoring other engineers. The technical stack includes PyTorch, Huggingface, VectorDBs, AWS Ultraclusters, and programming languages such as Python, Go, Scala, CUDA, and Java. The work focuses on building high-performance AI infrastructure and multi-model orchestration pipelines to solve complex problems in the banking sector by integrating LLMs and domain-specific models into unified systems while ensuring technical consistency and compliance with engineering standards.
What does a AI Engineer earn in California?
Median $246150 from 73 postings across 11 companies.
Develop and support AI software components including foundation model training, LLM inference, agentic workflows, and guardrails.
Implement state-of-the-art optimization techniques to improve performance, scalability, cost, and latency of large-scale production systems.
Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
Lead cost-performance governance reviews by tracking GPU utilization, model throughput, and inference cost efficiency.
Lead design councils to ensure technical consistency and compliance with established AI engineering standards.
Mentor senior engineers to foster cross-domain learning and improve organizational technical maturity.
Translate complex research papers into practical production techniques for high-impact business applications.
What we're looking for
Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 6 years of experience developing AI/ML algorithms.
Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 4 years of experience developing AI/ML algorithms.
At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
Experience leading development of AI systems with trade-offs regarding cost, latency, throughput, and accuracy (preferred).
7 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
Experience developing AI/ML algorithms using Python, C++, C#, Java, CUDA, or Golang (preferred).
Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost (preferred).
Experience building agentic AI systems and workflows (preferred).
Python
Go
CUDA
PyTorch
Huggingface
AWS
VectorDBs
LLM Inference
Agentic AI
Multi-agent Workflows
Similarity Search
Model Evaluation
Model Optimization
C++
Scala
Java
C#
Python
Go
CUDA
PyTorch
Huggingface
AWS
VectorDBs
LLM Inference
Multi-agent Workflows
Similarity Search
C++
Scala
Java
C#
Model Optimization
Machine Learning
AI Engineering