Lead Software Engineer, AI Foundation Services

JPMorgan Chase

Confirmed live yesterday Trusted

Quick summary

Work type
On-site
Location
Plano, TXJersey City, NJ
Posted
59 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

How this pay compares to similar roles

Similar $196k
$174k most similar roles pay here $231k

This listing doesn't post a salary. Most similar roles pay $181,775–$211,200.

Based on 240 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 1117 open roles on FindRole.

Listed pay typically runs $186,160–$215,000 across 7 roles with salary data.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Lead Software Engineer, AI Foundation Services

Lead Software Engineer-AI Foundation Services joins the Chief Data & Analytics AIML Data Platforms team to build AI foundation services for GenAI and ML. This role involves leading the hands-on delivery of secure, reliable, cloud-native platform capabilities while partnering with application teams to create reusable integrations, reference implementations, and onboarding assets. The engineer will develop production-grade code, APIs, SDKs, and libraries to standardize how teams consume model hosting and inference services. Key responsibilities include translating requirements into technical designs, managing delivery milestones, and promoting AI-assisted engineering practices. Required skills include 5+ years of experience with Python, Java, or Go, alongside expertise in Kubernetes, CI/CD, Terraform, and infrastructure-as-code. The role focuses on solving the challenge of providing scalable, production-ready infrastructure for machine learning workloads, including model gateways, inference optimization, and automated deployment workflows.

What you'll do

  • Implement AI Foundation Services to unblock GenAI use cases from technical design through launch.
  • Build reusable platform services, APIs, SDKs, and libraries to standardize how teams consume AI/ML managed services.
  • Translate functional requirements into clear technical designs, engineering tasks, and delivery milestones.
  • Develop secure, high-quality production code while performing code reviews, debugging, and defect remediation.
  • Create reference implementations, runbooks, and onboarding guides to accelerate adoption across application teams.
  • Drive the adoption of enterprise-authorized AI-assisted engineering practices to improve code quality and delivery speed.
  • Design and implement scalable software components using cloud-native practices and platform engineering standards.
  • Communicate technical progress, risks, and implementation options to managers and senior stakeholders.

What we're looking for

  • Formal training or certification in software engineering concepts.
  • 5+ years of applied experience in software engineering.
  • Strong hands-on coding experience in Python, Java, or Go for production-grade services or APIs.
  • Experience building shared services, reusable components, and platform capabilities for multiple teams.
  • Experience with infrastructure-as-code (Terraform), containers, Kubernetes, and CI/CD pipelines.
  • Demonstrated experience leading the use of approved AI-assisted software development tools.
  • Strong understanding of responsible AI use, including data sensitivity and secure handling of inputs/outputs.
  • Practical experience in system design, automated testing, debugging, and production observability (logging, metrics, alerts).

More like this

Similar roles

Lead Software Engineer, AI Engineer

JPMorgan Chase

Plano, TX 46 days ago
Java Python AWS Kubernetes Docker LLM Generative AI PyTorch TensorFlow scikit-learn Hugging Face REST Microservices CI/CD Helm RAG Agile Scrum
5+ yrs exp

AI Engineer, Lead Software Engineer

JPMorgan Chase

Jersey City, NJ 79 days ago
LLM Agentic AI AWS Kubernetes Serverless Semantic Search API Design Distributed Systems Observability
5+ yrs exp

Lead Software Engineer, AI Developer

JPMorgan Chase

Plano, TX 72 days ago
Java Python Node.js RAG LangChain LlamaIndex Semantic Kernel CrewAI AWS Bedrock Anthropic Claude Pinecone OpenSearch pgvector FAISS Lambda Step Functions API Gateway S3 DynamoDB SQS Docker ECS EKS CI/CD REST GraphQL Microservices Prompt Engineering
10+ yrs exp

Lead Software Engineer, Cloud AI Engineer

JPMorgan Chase

Plano, TX 28 days ago
Python AWS Terraform Django React RAG LLM LangChain LlamaIndex CrewAI Pinecone Weaviate pgvector Chroma Databricks CI/CD GitHub Copilot Claude Data Engineering
5+ yrs exp

Lead AI Engineer

Capital One Financial

New York, NY +4 55 days ago $179,400$204,700
Python Go Scala Java C++ C# AWS Huggingface PyTorch VectorDBs LLM Inference Similarity Search Nemo Guardrails Machine Learning Model Evaluation Observability
4+ yrs exp