Software Engineer III, AIML

JPMorgan Chase

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Mc Lean, VAJersey City, NJ
Employment: Full-time
Posted: 6 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $169k

$114k $217k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $130,500–$207,000.

Based on 240 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 1226 open roles on FindRole.

Listed pay typically runs $156,750–$215,000 across 5 roles with salary data.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Software Engineer III, AIML

Role Posting Log in to save

As a Software Engineer III - AIML within the Corporate AIML Data Platforms team at JPMorganChase, you will join an agile team to build and deliver trusted, scalable technology products. You will design, develop, and maintain backend services in Go and Python to support LLM-enabled experiences. Your daily responsibilities include building gRPC services defined with Protobuf, implementing bidirectional streaming endpoints for LLM workloads, and integrating services with authentication, caching, and persistence layers. You will also instrument services with observability tools like OpenTelemetry and manage production reliability through automated testing and debugging. The role requires expertise in Go concurrency, Python for automation, and secure coding practices. You will solve technical problems related to LLM streaming, session state management, and responsible AI usage within a secure enterprise environment.

What does a Software Engineer earn in Virginia?

Median $165000 from 125 postings across 23 companies.

See salary data

Skills

Go Python gRPC Protobuf LLM OpenTelemetry Kubernetes Docker Kafka RabbitMQ SQS Redis Microservices Integration Testing mTLS Observability

What you'll do

Design, build, and maintain secure backend services using Go and Python.
Develop gRPC services with Protobuf, including API design and schema evolution.
Implement bidirectional streaming gRPC endpoints specifically for LLM workloads.
Integrate LLM services with authentication, rate limiting, caching, and persistence systems.
Instrument services with metrics, logging, and tracing to ensure high observability.
Debug SDK integrations and participate in code reviews to maintain engineering standards.
Automate recurring fixes to improve system reliability, latency, and operational stability.
Utilize AI coding tools to generate, refactor, and test complex software deliverables.

What we're looking for

Formal training or certification on software engineering concepts and 3+ years of applied experience.
Proficiency in Go for backend development, including concurrency patterns, context usage, and performance troubleshooting.
Working knowledge of Python for supporting services, internal tooling, automation, or data/ETL tasks.
Hands-on experience with gRPC and Protobuf in production, including API design and compatibility considerations.
Experience building and operating microservices/APIs with a production mindset for monitoring, debugging, and incident support.
Proficiency in automation, continuous delivery methods, and strong unit/integration testing discipline.
Proficiency in secure coding practices and core SDLC activities including design, build, test, deploy, and operate.
Hands-on experience using enterprise-authorized AI-assisted software development tools to create, validate, and refine outputs.

Save