Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One Financial

Quick summary

Work type: On-site
Location: New York, NY · McLean, VA · Cambridge, MA · San Jose, CA
Salary: $229,900–$262,400 / yr
Posted: 65 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $223k

This role $246k

$173k most similar roles pay here $272k

This role pays more than 74% of similar roles. Most pay $196,562–$249,750 — the shaded band above. At the midpoint, this role pays about $246k versus about $223k for comparable roles.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 498 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 495 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Senior Lead AI Engineer (FM Hosting, LLM Inference)

Apply Now Log in to save

As a Senior Lead AI Engineer at COPSSC, you will join the FM Hosting team responsible for LLM inference services. Your primary focus will be to design and implement scalable solutions that enhance our large language model's performance and efficiency. You will work closely with other engineers to build robust systems that support real-time processing and analysis of vast amounts of data. The ideal candidate is proficient in Python, has extensive experience with cloud platforms like AWS or Azure, and possesses a strong background in machine learning frameworks such as TensorFlow or PyTorch. Additionally, you should have hands-on experience with containerization tools like Docker and Kubernetes to ensure seamless deployment and management of AI models at scale.

Skills

Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD Prometheus Grafana PostgreSQL Redis Git Jenkins

What you'll do

Design and optimize large language model (LLM) inference pipelines.
Implement efficient hosting solutions for LLMs in a cloud environment.
Develop and maintain scalable infrastructure for AI applications.
Monitor and enhance performance of AI systems in real-time.
Troubleshoot complex technical issues related to AI deployment.

What we're looking for

5+ years of experience in AI and machine learning.
Proven expertise in large language model inference and deployment.
Strong background in cloud hosting solutions for AI applications.
Experience with full-stack development, including backend and frontend technologies.
Excellent problem-solving skills and a deep technical understanding.

Save