Lead Software Engineer, MLIO Virtual Conversation Assist

JPMorgan Chase

Confirmed live yesterday Low trust

Quick summary

Work type: On-site
Location: OH
Posted: 157 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $208k

$176k most similar roles pay here $230k

This listing doesn't post a salary. Most similar roles pay $192,050–$223,750.

Based on 240 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 1138 open roles on FindRole.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Lead Software Engineer, MLIO Virtual Conversation Assist

Role Posting Log in to save

As a Lead Software Engineer - MLIO Virtual Conversation assist within the Consumer and Community Banking Machine Learning Intelligence Operations team, you will join an agile group focused on building and delivering secure, stable, and scalable technology products. You will collaborate with cross-functional teams to align requirements, provide technical guidance to vendors and contractors, and develop high-quality production code while reviewing others' work. Your daily tasks involve managing the end-to-end request lifecycle for Large Language Models, including handling streaming responses, prompt engineering, and evaluating model output quality. You will utilize technologies such as Java, Python, Terraform, and Amazon Bedrock alongside AWS services like EC2, S3, Lambda, and RDS. The role addresses technical challenges in Agentic AI and ML Engineering to solve complex problems regarding response latency, token usage, and cost implications within the machine learning domain.

Skills

Python Java AWS Terraform Amazon Bedrock LLM GenAI Agentic AI ECS EKS S3 Lambda RDS EC2 Prompt Engineering Machine Learning System Design

What you'll do

Develop secure, high-quality production code while reviewing and debugging code written by other team members.
Implement Large Language Model (LLM) integrations including API calls, streaming responses, and end-to-end request lifecycle management.
Perform prompt engineering tasks such as context window management and token budgeting for LLM applications.
Deploy and manage infrastructure using Terraform and AWS services like Bedrock, EC2, S3, and Lambda.
Provide technical guidance and direction to business teams, contractors, and vendors.
Drive decisions regarding product design, application functionality, and technical operations.
Advocate for firm-wide engineering frameworks and software development life cycle practices.
Solve complex system design and functionality problems independently with minimal oversight.

What we're looking for

Formal training or certification in software engineering concepts.
5+ years of applied experience in software engineering.
Degree or experience in Computer Science, Computer Engineering, Mathematics, or a related technical field.
Advanced proficiency in one or more programming languages such as Java or Python.
Practical experience with AWS cloud native services and infrastructure deployment using Terraform.
Hands-on experience with Large Language Models (LLMs), prompt engineering, and Agentic AI concepts.
Experience in system design, application development, testing, and ensuring operational stability.
Advanced knowledge of technical disciplines such as AI/ML or other specialized software domains.