Staff AI Engineer

CVS Health

Confirmed live yesterday High trust
Closes in 7 days Remote

Quick summary

Work type
Remote
Location
NYIDGAILFL
Salary
$106,605–$260,590 / yr
Posted
2 days ago
Freshness
Confirmed live yesterday
Closes
Sep 26, 2026 (soon)

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $205k
This role $184k
$88k most similar roles pay here $279k

This role pays less than 67% of similar roles. Most pay $170,950–$239,550 — the shaded band above. At the midpoint, this role pays about $184k versus about $205k for comparable roles.

Based on 240 similar postings.

Employer

About CVS Health

CVS Health is a leading American healthcare company operating retail pharmacies, pharmacy benefit management services, and a health insurance segment through Aetna, one of the nation''s largest health insurers. Industry: Healthcare & Pharmacy

CVS Health currently has 86 open roles on FindRole.

Listed pay typically runs $118,450–$284,280 across 85 roles with salary data.

Most-posted roles

View all roles at CVS Health

At a glance

TL;DR · Staff AI Engineer

Staff AI Engineer The Staff AI Engineer joins the engineering team to design, build, and operationalize scalable, secure, and responsible Generative AI solutions across the affiliate line of business. This role involves developing advanced machine learning models for complex healthcare problems using predictive modeling, deep learning, and natural language processing. The engineer will build production-grade LLM applications, RAG architectures, and agentic systems while managing data pipelines and model lifecycle operations in a HIPAA-regulated environment. Key technologies include AWS Bedrock, GCP Vertex AI, serverless compute, event-driven architectures, and vector search tools like Pinecone or OpenSearch. The candidate will utilize Python, Node.js, Java, and various agentic frameworks such as LangChain or LlamaIndex to deliver automated workflows. This role solves critical healthcare challenges by ensuring model interpretability, fairness, and compliance with strict data privacy standards for members and providers.

What does a AI Engineer earn in New York?

Median $211200 from 37 postings across 9 companies.

See salary data

What you'll do

  • Design and build scalable, secure Generative AI solutions using AWS Bedrock and GCP Vertex AI platforms.
  • Develop production-grade LLM applications utilizing serverless architectures, event-driven systems, and microservices.
  • Architect agentic AI systems to deliver multi-step reasoning and automated workflow orchestration for enterprise use cases.
  • Build robust Retrieval-Augmented Generation (RAG) systems using vector databases and custom retrieval pipelines.
  • Manage the full machine learning lifecycle including data engineering, model fine-tuning, evaluation, and performance monitoring.
  • Ensure all AI solutions comply with HIPAA regulations, data privacy standards, and Responsible AI governance.
  • Optimize production workloads for cost, performance, token usage, and latency across cloud environments.
  • Mentor engineers and provide technical leadership to shape product roadmaps and reusable platform accelerators.

What we're looking for

  • Bachelor’s degree or equivalent experience (HS diploma plus 4 years relevant experience).
  • 7+ years of experience in large-scale software development.
  • 5+ years of experience in solution architecture or system design.
  • 5+ years of experience building large-scale microservices and APIs using Node.js.
  • 3+ years of hands-on experience with GCP and AWS, including serverless, event-driven systems, AI/ML, and CI/CD.
  • Experience with AWS Bedrock or GCP Vertex AI (or similar technologies) for LLM and GenAI applications.
  • Strong experience with Python for AI/ML engineering.
  • Production experience with Agentic AI frameworks, RAG architectures, vector databases, and serverless designs.
  • Experience with Vertex AI’s Generative AI Studio, vector search orchestration, and agent capabilities (preferred).
  • Hands-on experience with vector databases such as OpenSearch, Pinecone, FAISS, pgvector, or Milvus (preferred).
  • Strong knowledge of prompt engineering, evaluation, observability, and LLM security patterns (preferred).
  • Ability to write design docs, architectural diagrams, runbooks, and technical briefs (preferred).
  • Agile/SAFe experience in large enterprises (preferred).
  • Cloud certifications from AWS or GCP (preferred).

More like this

Similar roles

Senior AI Engineer

CVS Health

Remote (NY) +3 2 days ago $83,430$203,940
Generative AI LLM RAG Python AWS Bedrock GCP Vertex AI Azure OpenAI LangChain LangGraph LlamaIndex Vector Databases Microservices Cloud-native Agile SAFe Prompt Engineering
5+ yrs exp Remote

Senior Manager AI Engineer

CVS Health

Remote (NY) +3 2 days ago $106,605$260,590
Generative AI Agentic AI RAG AWS Bedrock GCP Vertex AI Azure AI LangChain LlamaIndex LangGraph Pinecone OpenSearch pgvector FAISS Milvus Microservices Serverless Event-driven Architecture Agile Scrum SAFe
7+ yrs exp Remote

Staff AI Engineer

Capital One Financial

San Francisco, CA +4 15 days ago $269,100$307,200
Python Go Scala Java C++ C# PyTorch Huggingface AWS VectorDBs LLM Inference Similarity Search Nemo Guardrails Machine Learning SaaS
8+ yrs exp

Staff Applied AI Engineer

Fiserv

Sunnyvale, CA 2 days ago $160,000$240,000
LLM RAG Python Java Kotlin Scala Kubernetes MySQL MongoDB Vector Databases Spring Boot LangChain LlamaIndex Vertex AI Gemini Claude GPT Llama REST APIs Microservices TDD BDD
10+ yrs exp

Staff Engineer, Applied AI

GEICO

Remote (Bethesda, MD) 71 days ago $110,000$230,000
Generative AI LLMs Agentic Workflows Vector Databases Knowledge Graphs Java Spring AI LangChain4j Embabel Distributed Systems Performance Optimization Reliability Engineering Document Intelligence
8+ yrs exp Remote

Staff Engineer, AI Native

Sony Group Corporation

Remote (San Diego, CA) +1 3 days ago $220,000$240,000
Python Go Java TypeScript React Angular Ember Jest Babel HTML CSS REST API AWS Docker Kubernetes Terraform Ansible Jenkins CI/CD Prompt Engineering Claude Code Cursor GitHub Copilot
8+ yrs exp Remote