Principal AI Engineer

McKesson Corporation

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Columbus, OHAtlanta, GA
Salary
$195,000–$325,000 / yr
Employment
Full-time
Posted
3 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $218k
This role $260k
$121k $347k
below market most similar roles pay here above market

This role pays more than 79% of similar roles. Most pay $187,041–$248,337 — the blue band above. At the midpoint, this role pays about $260k versus about $218k for comparable roles.

Based on 240 similar postings.

Employer

About McKesson Corporation

McKesson Corporation is a premier American healthcare services company that distributes pharmaceuticals, medical-surgical supplies, and provides technology to the healthcare industry.

McKesson Corporation currently has 143 open roles on FindRole.

Listed pay typically runs $124,300–$207,200 across 78 roles with salary data.

Most-posted roles

View all roles at McKesson Corporation

At a glance

TL;DR · Principal AI Engineer

The Principal AI Engineer provides high-level technical leadership for the company's AI platform, operating one level above the Lead AI Engineer role. This individual establishes multi-year architecture strategies for agentic and LLM-powered systems, including model strategy, retrieval-augmented generation, and evaluation governance across all teams. Key responsibilities include resolving ambiguous technical problems, advising executive leadership on AI risk, and setting security standards for regulated healthcare data environments. The role requires building production LLM applications using Python, Java, REST APIs, and cloud-native designs in Azure, AWS, or GCP. Candidates must demonstrate expertise in prompt engineering, vector retrieval systems, and LLMOps. The position solves complex technical challenges regarding model risk, PHI handling, and infrastructure vendor management within a highly regulated healthcare context to ensure safe, durable, and scalable AI adoption.

What does a AI Engineer earn?

Median $211200 from 149 postings across 42 companies.

See salary data

What you'll do

  • Own the multi-year technical strategy and roadmap for the enterprise AI platform across all teams.
  • Serve as the final technical escalation point for the most ambiguous architecture and reliability problems.
  • Set architecture, security, and evaluation standards for multiple engineering teams to adopt.
  • Act as the primary technical voice to executive leadership on AI strategy, risk, and investment.
  • Lead architecture and prototyping for the organization's highest-risk and highest-ambiguity AI initiatives.
  • Shape enterprise-wide AI governance policy regarding model risk, connector approvals, and PHI handling.
  • Manage the long-term evaluation and strategy for foundation model providers and AI infrastructure vendors.
  • Mentor Lead and Senior AI Engineers through design reviews and structured technical coaching.

What we're looking for

  • Bachelor's degree or equivalent experience; typically 12+ years of software engineering experience, including 6+ years in AI/ML, LLM, or NLP systems.
  • 3+ years of experience operating as a senior individual-contributor technical leader.
  • Fewer years of experience are required with a relevant Master's or Doctorate.
  • Demonstrated technical leadership above a Lead AI Engineer level, setting standards and strategy across multiple teams.
  • Deep hands-on expertise in production LLM applications, including prompt engineering, RAG, agentic workflows, and evaluation harnesses.
  • Proficiency in Python and/or Java, REST APIs, event-driven architecture, microservices, and cloud-native design (Azure preferred).
  • Deep working knowledge of LLMOps/MLOps, including usage attribution, cost monitoring, and model evaluation pipelines.
  • Advanced degree (M.S. or Ph.D.) in Computer Science, AI/ML, or a related technical field (preferred).

More like this

Similar roles

Principal AI Engineer

Humana

New York, NY +2 39 days ago $206,600–$284,300
Python TypeScript JavaScript React Next.js PostgreSQL Gemini Vertex AI OCR Document AI Docker Kubernetes CI/CD RAG LLM Agentic Workflows Model Context Protocol (MCP) Distributed Systems Cloud-native Architecture
10+ yrs exp Hybrid

Principal AI Engineer

CVS Health

Remote (TX) +5 4 days ago $144,200–$288,400
GenAI Agentic AI RAG Python AWS GCP Vertex AI AWS Bedrock Vector Databases Node.js TypeScript Java CI/CD Infrastructure-as-Code Terraform Kubernetes LangSmith Arize Langfuse Ragas LoRA PEFT Serverless APIs Microservices
10+ yrs exp Remote

Principal AI Engineer II

AbbVie

North Chicago, IL 64 days ago $141,500–$268,500
Artificial Intelligence Machine Learning AWS MLOps CI/CD Containerization Infrastructure as Code Microservices APIs Observability Data Integrity Cybersecurity GxP Model Validation Responsible AI Cloud Engineering
9+ yrs exp

Lead AI Engineer

McKesson Corporation

Columbus, OH +2 3 days ago $155,300–$258,800
LLM RAG GraphRAG Agentic Workflows Python Java Azure AWS GCP LLMOps MLOps REST APIs Microservices Embeddings Prompt Engineering Model Context Protocol (MCP) OpenAI Anthropic Confluence Jira
8+ yrs exp Hybrid

Principal AI Engineer

CNA Financial

Chicago, IL 24 days ago $97,000–$189,000
AI Engineering Agentic Workflows CI/CD GCP Kubernetes GKE Terraform GitHub Actions Claude Code Cursor GitHub Copilot MCP Protocol Context Engineering infrastructure-as-code JFrog Artifactory Application Security LLM Evaluation Multi-agent Orchestration
9+ yrs exp Hybrid

Principal AI Engineer

Hewlett Packard Enterprise

Remote (Wisconsin) +4 9 days ago $157,000–$361,000
Machine Learning Deep Learning Python TensorFlow PyTorch Natural Language Processing Computer Vision Java C++ Git Agile Data Mining Data Modeling Statistical Modeling Distributed Computing Neural Networks CNN RNN GAN
8+ yrs exp Remote