Senior Staff Engineer, AI Compute

Capital One Financial

Confirmed live today Trusted
Remote

Quick summary

Work type
Remote
Location
San Francisco, CACambridge, MARichmond, VAMcLean, VASan Jose, CANew York, NY
Employment
Full-time
Posted
57 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $215k
$141k $292k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $186,597–$244,062.

Based on 240 similar postings.

Employer

About Capital One Financial

Capital One Financial is a bank holding company specializing in credit cards, auto loans, banking, and savings products, known for its data-driven approach to consumer and commercial finance. Industry: Financial Services & Banking

Capital One Financial currently has 2107 open roles on FindRole.

Listed pay typically runs $197,300–$225,100 across 1107 roles with salary data.

Most-posted roles

View all roles at Capital One Financial

At a glance

TL;DR · Senior Staff Engineer, AI Compute

JOB TITLE: Senior Staff Engineer, AI Compute (Remote Eligible) The machine learning platform organization seeks a Senior Staff Engineer to engineer and scale foundational compute capabilities for a cloud-based enterprise AI+ML system. You will architect and build control and data plane implementations for a highly available, multi-tenant platform supporting real-time and batch workloads. Day-to-day responsibilities include developing Ray and Spark distributed compute engine solutions to accelerate LLM pre-training, reinforcement learning, and large-scale data processing while maximizing compute unit economics. You will utilize Golang, Python, Scala, and Java alongside frameworks such as Spark, Dask, Ray, and Flink. The role requires expertise in Kubernetes, AWS Lambda, and GPU substrates to solve the technical challenge of providing scalable, high-performance infrastructure for generative AI inference and agentic applications.

What does a Engineer earn in California?

Median $199500 from 103 postings across 31 companies.

See salary data

What you'll do

  • Architect and build control and data plane implementations for a multi-tenant, large-scale machine learning platform.
  • Develop Ray and Spark distributed compute engine solutions to accelerate LLM pre-training and large-scale data processing.
  • Engineer systemic improvements to automate operational workflows and improve overall platform excellence.
  • Direct the technical execution of a diverse project portfolio involving distributed microservices and foundation models.
  • Optimize business outcomes by working cross-functionally with product, program management, and internal stakeholders.
  • Lead system design and code review sessions while serving as a technical resource for the engineering community.
  • Mentor internal talent and actively recruit external candidates to bolster the technology talent pool.

What we're looking for

  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 10 years of experience developing AI and ML algorithms or technologies.
  • Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 8 years of experience developing AI and ML algorithms or technologies.
  • At least 10 years of experience programming with Python, Go, Scala, or Java.
  • Master’s Degree in Computer Science or a Master’s Degree in Software Engineering (preferred).
  • Hands-on experience in the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management) (preferred).
  • Experience building platforms that support LLM training, fine-tuning, or high-throughput inference (preferred).
  • Hands-on experience with AWS-specific compute primitives (EKS, EC2 UltraClusters, Graviton) and cost-optimization strategies (preferred).
  • History of upstream contributions to major distributed systems projects (preferred).

More like this

Similar roles

Staff AI Engineer

Capital One Financial

Remote (San Francisco, CA) +3 57 days ago
Python Go Scala Java C++ C# PyTorch AWS Huggingface VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning Google Cloud Azure
8+ yrs exp Remote

Staff AI Engineer

Capital One Financial

Remote (San Francisco, CA) +5 56 days ago
Python Go Scala Java C++ C# PyTorch Huggingface AWS Google Cloud Azure VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning
8+ yrs exp Remote

Senior Staff Engineer

Capital One Financial

Remote (McLean, VA) 40 days ago
Java Python Go JavaScript TypeScript Swift Distributed Systems Solution Architecture Enterprise Architecture Design Patterns AI Tooling System Development Production Support
9+ yrs exp Remote

Staff AI Engineer

Capital One Financial

Remote (San Francisco, CA) +5 60 days ago
Python Go Scala Java C++ C# PyTorch Huggingface AWS Google Cloud Azure VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning
8+ yrs exp Remote

Senior Staff AI Engineer

Capital One Financial

San Francisco, CA +4 56 days ago
Python Go Scala Java C++ C# PyTorch AWS Huggingface VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning Google Cloud Azure
10+ yrs exp

Staff Engineer, Agentic AI

Capital One Financial

Remote (McLean, VA) +1 43 days ago
Agentic AI AWS Python Java Go TypeScript JavaScript Swift Microsoft Azure Google Cloud RLAIF Cloud Computing Solution Architecture Enterprise Architecture
7+ yrs exp Remote