Principal Software Engineer, AI Foundations

JPMorgan Chase

Confirmed live today Low trust

Quick summary

Work type
On-site
Location
Jersey City, NJPalo Alto, CASeattle, WANew York, NY
Employment
Full-time
Posted
103 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $198k
$127k $291k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $169,550–$225,500.

Based on 240 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 1226 open roles on FindRole.

Listed pay typically runs $156,750–$215,000 across 5 roles with salary data.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Principal Software Engineer, AI Foundations

The Principal Software Engineer - AI Foundations joins the Chief Data and Analytics Office to provide engineering excellence within an agile team. This role involves designing, building, and troubleshooting AI-enabled applications and services while developing secure production code. Key responsibilities include implementing end-to-end MLOps capabilities, such as data versioning and reproducible training pipelines, and contributing to next-generation training techniques like distributed fine-tuning and RLHF workflows. The engineer will architect agentic AI-enabled engineering workflows to improve delivery speed and code quality. Required technical skills include proficiency in Python, Java, Scala, or Go, alongside experience with cloud-native technologies, containers, and IaC. The work focuses on solving complex problems in platform engineering, ML systems, and data engineering to deliver scalable, secure, and stable technology products.

What does a Software Engineer earn in New Jersey?

Median $161500 from 34 postings across 14 companies.

See salary data

What you'll do

  • Design, build, and troubleshoot scalable AI-enabled applications and services.
  • Develop, review, and debug high-quality production code for secure and stable systems.
  • Implement end-to-end MLOps capabilities including data versioning, CI/CD for models, and continuous monitoring.
  • Contribute to next-generation training techniques like distributed fine-tuning and synthetic data generation.
  • Architect and govern agentic AI-enabled engineering workflows to improve delivery speed and code quality.
  • Create durable, reusable frameworks and platform components for use across multiple teams.
  • Identify recurring issues and automate remediation to improve the reliability of AI features.
  • Own and support SDK and service integrations to ensure performance and maintainability.

What we're looking for

  • Formal training or certification on software engineering concepts and 7+ years of applied experience.
  • Hands-on experience delivering system design, application development, testing, and operational stability for large-scale platforms and services.
  • Expert proficiency in one or more programming languages such as Python, Java, Scala, or Go.
  • Demonstrated experience designing and leading adoption of agentic AI-enabled development practices across teams.
  • Proven ability to design and operate ML/LLM platforms including reproducible training pipelines and model/data versioning.
  • Practical cloud-native experience with containers, orchestration, IaC, and observability.
  • Strong communication skills to present to and influence senior leaders and executives.
  • Practical experience with distributed compute and scalable model training/fine-tuning (preferred).

More like this

Similar roles

Principal Software Engineer

JPMorgan Chase

Jersey City, NJ +1 99 days ago
Python Java LLM RAG Agentic AI AWS Azure GCP Kafka Redis MemCached Airflow Temporal Spark PySpark Databricks Snowflake Apache Iceberg Dynatrace Splunk Grafana Microservices API Design Vector Stores
7+ yrs exp

Principal AI Software Engineer

Palo Alto Networks

Santa Clara, CA 141 days ago $223,000–$306,500
Python Generative AI LLMs Multi-Agent Systems GPT-4 Llama 3 Anthropic LangSmith Arize HoneyHive OpenTelemetry Java Node.js Agile Scrum API Design AI Gateway Observability Pipelines
10+ yrs exp

Principal Software Engineer, Core AI Platform

JPMorgan Chase

Seattle, WA 56 days ago
Python AI Infrastructure Machine Learning Distributed Systems Cloud Platforms System Design Observability APIs SDKs SRE Automated Testing Logging Metrics Incident Response Root-Cause Analysis Generative AI Infrastructure Engineering
10+ yrs exp

Principal Software Engineer, AI-Powered Work

Intuit

Mountain View, CA +1 5 days ago $261,500–$353,500
Python Java TypeScript AI Agents Cloud Services system-design Agent Orchestration Retrieval Identity Systems Data Platforms Workflow Automation Monitoring Security
10+ yrs exp

Principal Software Engineer, CoreAI

Microsoft

48 days ago $142,800–$274,800
Python C++ Java C# JavaScript vLLM SGLang Ray VERL Slime GPU Computing Distributed Training ML Systems AI Infrastructure Data Analytics Disaggregated Inference Reinforcement Learning
10+ yrs exp Hybrid

Principal Platform Software Engineer, AI

Oracle

Nashville, TN 73 days ago $104,500–$234,600
Python Go Java C++ Kubernetes OCI Distributed Systems Machine Learning LLMs CI/CD PyTorch TensorFlow Hugging Face Transformers Microservices Event-driven Systems Infrastructure Automation Service Mesh APIs Data Modeling
8+ yrs exp