below marketmost similar roles pay hereabove market
This role pays more than
82%
of similar roles. Most pay
$192,050–$211,200
— the blue band above.
At the midpoint, this role pays about
$211k
versus about
$202k
for comparable roles.
Based on 240 similar postings.
Employer
About Capital One Financial
Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking
Capital One Financial currently has
2253 open roles
on FindRole.
Listed pay typically runs
$197,300–$225,100
across 1137 roles with salary data.
The AI Engineer 4 (AI Foundations) joins the Intelligent Foundations and Experiences team to develop proprietary, scalable AI solutions for banking. This role involves designing, developing, testing, and supporting AI software components, including foundation model training, large language model inference, agents, multi-agent workflows, similarity search, guardrails, and model evaluation. You will own end-to-end architecture for complex systems, ensuring maintainability, observability, and ethical alignment while optimizing GPU/TPU utilization. The position requires proficiency in Python, Go, Scala, CUDA, or Java, alongside experience with AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch. You will solve technical problems related to model performance, cost, latency, and throughput, translating scientific research into production-ready systems that provide reliable, responsible AI capabilities for high-leverage impact across the enterprise.
What does a AI Engineer earn in New York?
Median $245450 from 71 postings across 9 companies.
Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
Implement agents, multi-agent workflows, similarity search, guardrails, and model evaluation systems.
Invent and introduce state-of-the-art optimization techniques to improve performance, scalability, cost, and latency of production AI.
Own the end-to-end architecture for complex AI systems to ensure maintainability, observability, and ethical alignment.
Define and maintain service-level objectives for AI reliability, including latency, uptime, and model performance drift.
Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
Lead cross-functional technical reviews to ensure new AI deployments meet security, data governance, and compliance standards.
Mentor senior associates on scalable design, performance tuning, and translating research into production.
What we're looking for
Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4 years of experience developing AI and ML algorithms or technologies.
Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 2 years of experience developing AI and ML algorithms or technologies.
At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
Experience leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy (preferred).
6 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
Experience designing, developing, delivering, and supporting AI services (preferred).
Experience developing AI and ML algorithms using Python, C++, C#, Java, CUDA, or Golang (preferred).
Experience developing and applying state-of-the-art techniques for optimizing training and inference software (preferred).
Python
Go
Scala
CUDA
Java
C++
C#
PyTorch
Huggingface
AWS
Google Cloud
Azure
VectorDBs
LLM Inference
Distributed Systems
Model Evaluation
Observability
GPU
TPU
Python
Go
Scala
CUDA
Java
C++
C#
PyTorch
Huggingface
AWS
Google Cloud
Azure
VectorDBs
LLM Inference
Distributed Systems
Model Evaluation
Observability
GPU
TPU
Python
Go
Scala
CUDA
Java
C++
C#
PyTorch
AWS
Huggingface
VectorDBs
LLM Inference
Distributed Systems
GPU
TPU
Similarity Search
Model Evaluation
Observability
Data Governance