Senior Principal Software Engineer, AI Foundation Services

JPMorgan Chase

Quick summary

Work type
On-site
Location
Plano, TXJersey City, NJ
Salary
$232,750–$325,000 / yr
Posted
2 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $205k
This role $279k
$126k most similar roles pay here $346k

This role pays more than 95% of similar roles. Most pay $174,200–$235,750 — the shaded band above. At the midpoint, this role pays about $279k versus about $205k for comparable roles.

Based on 239 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 436 open roles on FindRole.

Listed pay typically runs $152,000–$215,000 across 230 roles with salary data.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Senior Principal Software Engineer, AI Foundation Services

Role Posting Log in to save

As a Senior Principal Software Engineer at JPMorganChase within AMDP/CDAO, you will serve as a hands-on thought leader for AI Foundation Services, building scalable and secure infrastructure for large-scale GenAI and traditional AI/ML platforms. You will collaborate with Lines of Business teams to develop reusable foundational services and managed service patterns, ensuring delivery from design through early operations while focusing on performance, reliability, and security. Key responsibilities include driving firmwide reuse through shared reference architectures and test harnesses, setting strategic standards for agentic AI-enabled engineering, and advising senior leaders on responsible AI practices. The role requires expertise in cloud-native architecture, Kubernetes, Terraform, and GPU-backed model hosting platforms, as well as experience with LLM and model serving stacks in production environments. This position demands a strong understanding of performance engineering, secure-by-design practices, and the ability to influence across business and technology teams.

Skills

Kubernetes Terraform CI/CD Python PostgreSQL AWS LLM GPU Docker Prometheus Grafana Responsible AI Performance Engineering Cloud Native Architecture Secure By Design Service Level Indicators Incident Response Load Testing Capacity Planning Model Serving Stacks

What you'll do

  • Leads technical design and optimization of AI Foundation Services infrastructure for GenAI and traditional AI/ML platforms.
  • Synthesizes LOB requirements into implementable designs, driving delivery from concept to operational support.
  • De-risks project delivery by defining non-functional requirements, testing strategies, and operational readiness criteria.
  • Drives firmwide reuse through shared reference architectures, playbooks, and GPU training/serving baselines for model hosting platforms.
  • Advises on strategy and development of multiple AI-enabled products and technologies across teams/functions.

What we're looking for

  • Proven hands-on experience designing and operating AI/ML platform capabilities.
  • Demonstrated expertise in performance engineering and production reliability.
  • Strong understanding of responsible AI use and control expectations at scale.
  • Extensive practical cloud-native experience with Kubernetes, containers, CI/CD.
  • Experience building GPU-backed model hosting platforms and optimizing performance.
  • Ability to lead end-to-end technical engagements with senior stakeholders.
  • Demonstrated prior experience influencing across functions and delivering value at scale.

Related searches

More Senior Principal Software Engineer jobs Senior Principal Software Engineer jobs in Plano All jobs at JPMorgan Chase

More like this

Similar roles

Principal Software Engineer, AI Foundation Services

JPMorgan Chase

Plano, TX +1 2 days ago $204,250–$285,000
Python Java Go Terraform CI/CD Kubernetes Docker Prometheus Grafana AWS GPU Model Serving Rate Limiting Authentication Authorization Threat Modeling Secure SDLC PostgreSQL Redis GitOps
Save

Senior Lead Software Engineer, AI Platform Engineer

JPMorgan Chase

San Francisco, CA +2 9 days ago $171,000–$260,000
Kubernetes Docker Python Go Java C# CI/CD Infrastructure-as-Code Prometheus Grafana MLflow vLLM Ray.io Slurm SQL NoSQL Linux NVIDIA DCGM NVIDIA BCM NVIDIA Dynamo Inference
Save

Principal Software Engineer, AI Engineer

JPMorgan Chase

Jersey City, NJ +2 2 days ago $204,250–$285,000
Python PyTorch TensorFlow AWS Azure MLOps CI/CD Prometheus Grafana Kubernetes Docker PostgreSQL Vector_storage_systems LLM_services_APIs_microservices Agentic_AI_enabled_development_practices Responsible_AI_practices
Save

Senior Lead Software Engineer, AI

JPMorgan Chase

Columbus, OH 1 day ago
Python TypeScript Cloud AI LLM MachineLearning LangChain LlamaIndex AutoGen CrewAI APIIntegration CLI DataPipelines CI/CD
Save

Senior Software Engineer, AI Core Engineering

The Walt Disney Company

Remote 122 days ago $141,900–$190,300
Python LLM APIs AWS Bedrock Azure AI Foundry LangChain LangGraph APIs SDKs OpenAI Anthropic Claude Observability Tracing Latency and cost dashboards Drift detection Multi-agent orchestration Synthetic data Enterprise governance Security Compliance Audit Policy enforcement
Remote
Save