This role pays more than
78%
of similar roles. Most pay
$176,225–$246,150
— the shaded band above.
At the midpoint, this role pays about
$246k
versus about
$211k
for comparable roles.
Based on 240 similar postings.
Employer
About Capital One Financial
Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking
Capital One Financial currently has
998 open roles
on FindRole.
Listed pay typically runs
$197,300–$225,100
across 992 roles with salary data.
Senior Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) joins the Intelligent Foundations and Experiences team to develop responsible, scalable AI systems for banking services. This role involves overseeing the design, development, testing, deployment, and support of critical software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. The manager will make build-vs-buy decisions across a stack featuring AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch while implementing LLM optimization techniques to improve performance, cost, and latency. Candidates must possess expertise in Python, C++, C#, Java, or Golang to solve complex technical problems. The role focuses on building high-performance AI infrastructure and proprietary solutions that enhance how customers interact with banking products through advanced machine learning and large-scale production systems.
Oversee the design, development, testing, deployment, and support of AI software components including LLM inference and guardrails.
Implement state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput for production systems.
Make high-judgment build-vs-buy decisions regarding open-source and SaaS technologies like Huggingface, VectorDBs, and PyTorch.
Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
Manage a team of engineers by providing mentorship, coaching, and professional development opportunities.
Translate complex scientific research into practical production techniques for large-scale AI infrastructure.
Partner with cross-functional teams to deliver AI-powered products that improve internal workflows and customer interactions.
What we're looking for
Bachelor's degree in Computer Science, AI, Electrical Engineering, or related fields with at least 6 years of experience developing AI/ML technologies.
Master's degree in Computer Science, AI, Electrical Engineering, or related fields with at least 4 years of experience developing AI/ML technologies.
At least 1 year of people leadership experience.
3 years of experience managing and leading an engineering team.
6 years of experience deploying scalable and responsible AI solutions on cloud platforms like AWS, Google Cloud, or Azure.
Experience developing AI and ML algorithms using Python, C++, C#, Java, or Golang.
Ability to identify and implement LLM optimization techniques for performance, scalability, cost, latency, and throughput.
Excellent communication skills to articulate complex AI concepts to peers.
Python
Go
Scala
Java
C++
C#
PyTorch
Huggingface
AWS
VectorDBs
LLM Inference
Nemo Guardrails
Machine Learning
Gen AI
Similarity Search
Model Evaluation
Observability
Python
Go
Scala
Java
C++
C#
AWS
Huggingface
PyTorch
VectorDBs
LLM Inference
Nemo Guardrails
Machine Learning
Gen AI
Similarity Search
Model Evaluation
Observability