Principal Software Engineer, AI Foundation Services

JPMorgan Chase

Quick summary

Work type
On-site
Location
Plano, TXJersey City, NJ
Salary
$204,250–$285,000 / yr
Posted
2 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $197k
This role $245k
$126k most similar roles pay here $302k

This role pays more than 85% of similar roles. Most pay $167,550–$226,375 — the shaded band above. At the midpoint, this role pays about $245k versus about $197k for comparable roles.

Based on 239 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 436 open roles on FindRole.

Listed pay typically runs $152,000–$215,000 across 230 roles with salary data.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Principal Software Engineer, AI Foundation Services

Role Posting Log in to save

As a Principal Software Engineer at JPMorganChase within AMDP/CDAO, you will collaborate with Lines of Business application teams to develop AI Foundation Services that simplify and secure large-scale GenAI/AI workloads. Your day-to-day involves translating business requirements into technical designs, implementing reusable platform components like APIs and SDKs, and ensuring robust observability and security through SLOs and runbooks. You will also advise on technological matters, create scalable coding frameworks, and drive the adoption of agentic AI practices to enhance development speed and operational efficiency. The role requires expertise in languages such as Python, Java, or Go, experience with Terraform for building shared services, and a deep understanding of cloud, artificial intelligence, and machine learning technologies. Additionally, familiarity with GPU-enabled platforms, model serving patterns, and regulated-environment engineering practices is essential to address complex technology challenges at scale.

Skills

Python Java Go Terraform CI/CD Kubernetes Docker Prometheus Grafana AWS GPU Model Serving Rate Limiting Authentication Authorization Threat Modeling Secure SDLC PostgreSQL Redis GitOps

What you'll do

  • Designs and co-develops AI Foundation Services capabilities with Lines of Business teams.
  • Implements reusable platform services and libraries to standardize model hosting and inference.
  • Translates business requirements into technical designs, breaking work into manageable milestones.
  • Ensures delivery is risk-free through performance testing, capacity planning, and security controls.
  • Produces reference architectures and runbooks to drive reuse across development teams.
  • Advises on technological matters and serves as a subject matter expert for AI-enabled workflows.

What we're looking for

  • Proven experience building production-grade APIs and shared services using Terraform.
  • Strong hands-on coding skills in Python, Java, or Go for platform service development.
  • Demonstrated ability to design and implement agentic AI-enabled engineering workflows.
  • Expertise in operating and maintaining systems with instrumentation, SLOs, and incident response.
  • Advanced knowledge of cloud, artificial intelligence, machine learning, and mobile technologies.
  • Experience optimizing GPU-enabled platforms for AI workloads and model serving patterns.
  • Familiarity with regulated-environment engineering practices in large enterprises.

Related searches

More Principal Software Engineer jobs Principal Software Engineer jobs in Plano All jobs at JPMorgan Chase

More like this

Similar roles

Senior Principal Software Engineer, AI Foundation Services

JPMorgan Chase

Plano, TX +1 2 days ago $232,750–$325,000
Kubernetes Terraform CI/CD Python PostgreSQL AWS LLM GPU Docker Prometheus Grafana Responsible AI Performance Engineering Cloud Native Architecture Secure By Design Service Level Indicators Incident Response Load Testing Capacity Planning Model Serving Stacks
Save

Principal Software Engineer, AI Engineer

JPMorgan Chase

Jersey City, NJ +2 2 days ago $204,250–$285,000
Python PyTorch TensorFlow AWS Azure MLOps CI/CD Prometheus Grafana Kubernetes Docker PostgreSQL Vector_storage_systems LLM_services_APIs_microservices Agentic_AI_enabled_development_practices Responsible_AI_practices
Save

Principal Software Engineer, Enterprise AI Platform

Nvidia

Santa Clara, CA 94 days ago $272,000–$431,250
Python Go Kubernetes containers Linux Terraform CI/CD Prometheus Grafana PostgreSQL Docker OAuth OpenID JWT SAML LDAP OAUTH2 OIDC SAML2 CAS Security_Telemetry Structured_Logs Traceability Metric_Collection Least_Privilege_Access Secrets_Management Incident_Response Threat_Modeling Authentication Authorization Runtime_Security Policy_Engines Workload_Isolation MicroVMs Linux_Security_Primitives
Save

Principal AI Software Engineer

Palo Alto Networks

Santa Clara, CA 15 days ago $167,000–$270,500
Python Java Go AWS Azure GCP Salesforce LLM GPT Anthropic Llama LangChain LangGraph SQL Docker Kubernetes CI/CD Prometheus Grafana
Save