(USA) Principal, Software Engineer

Walmart

Actively hiring Verified listing

(Usa) Crossman Excellence Building Ca Sunnyvale Home Office, US Posted 36 days ago $143,000–$286,000 / year

View original post Log in to save

At a glance

AI generated

TL;DR

As a Principal Engineer in Performance and Resiliency Engineering at Walmart, you will lead the development of intelligent, self-healing systems using agentic AI, operating across 10,500 stores and serving 240 million weekly customers. Your role involves architecting multi-agent pipelines that use large language models (LLMs) for decision-making and autonomous remediation, setting standards for LLM evaluation, and optimizing inference at scale. You will also integrate vector databases and observability stacks to build context-aware systems, drive chaos engineering experiments, and define service level objectives (SLOs). The team focuses on building foundational technologies that power Walmart's tech organization, emphasizing high ownership and measurable impact. Ideal candidates have over 10 years of experience in distributed systems, LLMs, performance engineering, and strong programming skills in Python or Java, along with familiarity with cloud-native infrastructure and ML frameworks like PyTorch and TensorFlow.

Skills

Python Java LLMs RAG-based systems SRE Kubernetes Docker GCP Azure PyTorch TensorFlow Hugging Face Transformers MLOps CI/CD Prometheus Grafana ELK Chaos Engineering DevOps AWS

What you'll do

Architect production multi-agent pipelines for agentic AI systems at scale.
Own LLM evaluation standards ensuring factuality, consistency, and safety.
Optimize LLM inference through prompt caching, quantization, and retrieval filtering.
Integrate vector databases and observability stacks to build context-aware systems.
Design chaos experiments to expose real failure modes and improve system resilience.

What we're looking for

10+ years experience building and operating distributed systems at scale
Proven hands-on production experience with LLMs, agentic frameworks, or RAG-based systems
Deep background in performance engineering, chaos engineering, or SRE with real ownership of SLOs and incident response
Strong programming skills in Python and/or Java; comfort working across the full ML stack
Familiarity with cloud-native infrastructure: GCP, Azure, Kubernetes, Docker

Market check

Salary context

This $143,000–$286,000 range sits above 94% of similar postings on FindRole.

Peer median band

$117,000–$234,000

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$165,000–$214,500

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Walmart

Walmart Inc. is the world''s largest retailer by revenue, operating a chain of hypermarkets, discount department stores, and grocery stores, as well as a growing e-commerce presence through Walmart.com. Industry: General Merchandise & Grocery Retail

Walmart currently has 495 open roles on FindRole.

Listed pay typically runs $117,000–$234,000 across 487 roles with salary data.

Most-posted roles

View all roles at Walmart

Similar roles

(USA) Principal, Software Engineer

Walmart

(Usa) Isd Office - Dgtc Ar Bentonville Home Office, US 41 days ago $110,000–$220,000

Python Docker CI/CD OAuth2/OIDC JSON_Schema OpenAPI Pydantic protobuf Kubernetes AWS Azure Google_Cloud_Platform PostgreSQL BigQuery Camunda_Zeebe Git Terraform Prometheus Grafana

(USA) Principal, Software Engineer

Walmart

(Usa) Isd Office - Dgtc Ar Bentonville Home Office, US 37 days ago $110,000–$220,000

Python Kubernetes CI/CD OAuth2/OIDC JSON Schema OpenAPI Pydantic protobuf Docker Camunda Zeebe Prometheus Grafana BigQuery Git SDKs CLIs Terraform PostgreSQL AWS Azure

(USA) Principal, Software Engineer

Walmart

(Usa) Crossman Respect Building Ca Sunnyvale Home Office, US 52 days ago $143,000–$286,000

Node.js Java Kotlin Git Jenkins Maven Google Cloud Platform BigQuery GCS Dataproc CI/CD Python PostgreSQL Docker Kubernetes AWS Prometheus Grafana Machine Learning Data Science

(USA) Principal, Software Engineer

Walmart

(Usa) Crossman Excellence Building Ca Sunnyvale Home Office, US 93 days ago $143,000–$286,000

Java SQL NoSQL Git Agile Scrum Kanban Jenkins Docker Kubernetes CI/CD Prometheus Grafana PostgreSQL MongoDB Redis AWS RDS MSSQL Oracle Azure Google Cloud Platform

(USA) Principal, Software Engineer

Walmart

(Usa) Redbird Ar Bentonville Home Office, US 86 days ago $110,000–$220,000

Java Python JavaScript CI/CD DevOps Kubernetes AWS Docker Terraform PostgreSQL MongoDB Redis APIs LMS intelligent automation adaptive learning AI/ML

(USA) Principal, Software Engineer

Walmart

(Usa) Crossman Respect Building Ca Sunnyvale Home Office, US 50 days ago $143,000–$286,000

Java Kotlin Python Go AWS Azure GAE Microservices REST APIs Scrum XP MySQL Oracle Cassandra Appium Selenium Jira Rest Assured Gatling CI/CD