below marketmost similar roles pay hereabove market
This role pays more than
76%
of similar roles. Most pay
$192,050–$211,200
— the blue band above.
At the midpoint, this role pays about
$211k
versus about
$202k
for comparable roles.
Based on 240 similar postings.
Employer
About Capital One Financial
Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking
Capital One Financial currently has
2276 open roles
on FindRole.
Listed pay typically runs
$197,300–$225,100
across 1147 roles with salary data.
The AI Engineer 4 (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning) joins the Intelligent Foundations and Experiences team to develop proprietary AI solutions for banking. You will design, develop, test, and deploy AI software components, including foundation model training, large language model inference, agents, multi-agent workflows, similarity search, guardrails, and model evaluation. The role involves inventing optimization techniques to improve performance, scalability, cost, and latency for production systems while owning end-to-end architecture and service-level objectives. You will utilize a technical stack including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, Python, Go, Scala, CUDA, and Java. This position solves complex problems regarding model governance, observability, and ethical alignment, translating scientific research into scalable production systems to enhance customer interactions and internal workflows.
What does a AI Engineer earn in New York?
Median $245800 from 72 postings across 9 companies.
Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
Build and manage agents, multi-agent workflows, similarity search, guardrails, and model evaluation systems.
Implement state-of-the-art optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
Own the end-to-end architecture for complex AI systems to ensure maintainability, observability, and ethical alignment.
Define and maintain service-level objectives for AI reliability, including latency, uptime, and model performance drift.
Optimize GPU/TPU utilization and accelerate model inference pipelines in collaboration with infrastructure engineering.
Lead cross-functional technical reviews to ensure new AI deployments meet security, data governance, and compliance standards.
Mentor senior associates on scalable design, performance tuning, and translating research into production environments.
What we're looking for
Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4 years of experience developing AI and ML algorithms.
Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 2 years of experience developing AI and ML algorithms.
At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
Experience leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy (preferred).
6 years of experience deploying scalable and responsible AI solutions on cloud platforms (preferred).
Experience designing, developing, delivering, and supporting AI services (preferred).
Experience developing AI and ML algorithms using Python, C++, C#, Java, CUDA, or Golang (preferred).
Experience developing and applying state-of-the-art techniques for optimizing training and inference software (preferred).
Python
Go
Scala
CUDA
Java
C++
C#
PyTorch
Huggingface
AWS
Google Cloud
Azure
VectorDBs
LLM Inference
Agentic AI
Distributed Systems
Model Evaluation
Observability
Data Governance
Python
Go
Scala
CUDA
Java
C++
C#
PyTorch
Huggingface
AWS
Google Cloud
Azure
VectorDBs
LLM Inference
Distributed Systems
Model Evaluation
Observability
GPU
TPU