Senior Lead AI Engineer (LLM Gateway, FM Hosting)

Capital One Financial

Actively hiring
McLean, VA · Cambridge, MA · San Jose, CA · New York, NY Posted 16 days ago $229,900–$262,400 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Senior Lead AI Engineer at COPSSC, you will join a cutting-edge team focused on developing and maintaining large language model (LLM) gateways and full-stack hosting solutions. Your primary responsibilities include designing scalable infrastructure to support LLMs, integrating advanced natural language processing capabilities, and ensuring seamless user experiences for complex AI applications. You will work closely with data scientists and software engineers to build robust, efficient systems that handle high volumes of requests while maintaining low latency and high accuracy. The ideal candidate possesses extensive experience in machine learning frameworks such as TensorFlow or PyTorch, proficiency in programming languages like Python and JavaScript, and a strong background in cloud technologies including AWS or Azure. This role demands expertise in natural language processing, distributed computing, and an understanding of the challenges associated with deploying large-scale AI models in real-world applications.

Skills

Python TensorFlow PyTorch Docker Kubernetes AWS CI/CD Git PostgreSQL Redis Scikit-learn Flask RESTful APIs Nginx Prometheus Grafana

What you'll do

  • Design and implement advanced LLM gateway solutions.
  • Optimize performance of large-scale machine learning models.
  • Develop robust frameworks for federated model hosting.
  • Ensure security and scalability in AI infrastructure.
  • Mentor junior engineers and guide project timelines.

What we're looking for

  • 5+ years of experience in leading AI engineering projects.
  • Proven expertise in developing and deploying large language models (LLM).
  • Strong background in full-stack development for hosting frameworks and middleware.
  • Experience with cloud platforms like AWS, Azure, or GCP for scalable solutions.
  • Excellent problem-solving skills and a deep understanding of machine learning principles.

Market check

Salary context

This $229,900–$262,400 range sits above 79% of similar postings on FindRole.

Peer median band

$179,700–$262,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$192,762–$246,150

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 489 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 483 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

More like this

Similar roles

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One Financial

Mclean, Va, US 123 days ago $229,900–$262,400
Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD PostgreSQL Redis Prometheus Grafana GitLab Jupyter Notebook Scikit-learn Pandas NumPy Hugging Face Transformers

Senior Lead AI Engineer (FM Hosting)

Capital One Financial

New York, Ny, US 109 days ago $229,900–$262,400
Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD Git Jupyter Notebook PostgreSQL MongoDB Scikit-learn Pandas NumPy Flask RESTful APIs Swagger GraphQL

Senior Lead AI Engineer

Capital One Financial

San Jose, Ca, US 70 days ago $229,900–$262,400
Python TensorFlow PyTorch Kubernetes Docker AWS CI/CD Git Jupyter PostgreSQL MongoDB Scikit-learn Pandas NumPy Redis ELK_stack Prometheus Grafana