Software Engineering Manager

Ally Financial

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Detroit, MICharlotte, NC
Salary
$110,000–$180,000 / yr
Employment
Full-time
Posted
5 days ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $179k
This role $145k
$96k $244k
below market most similar roles pay here above market

This role pays less than 71% of similar roles. Most pay $142,400–$216,300 — the blue band above. At the midpoint, this role pays about $145k versus about $179k for comparable roles.

Based on 240 similar postings.

Employer

About Ally Financial

Ally Financial is a US-based digital financial services company offering online banking, auto financing, mortgage, and investment products. It is one of the largest all-digital banks in the United States.

Ally Financial currently has 28 open roles on FindRole.

Listed pay typically runs $110,000–$180,000 across 27 roles with salary data.

Most-posted roles

View all roles at Ally Financial

At a glance

TL;DR · Software Engineering Manager

Mgr - Software Eng As a GenAI Tech Lead, you will join the engineering team to drive the end-to-end development of enterprise-grade generative and agentic AI solutions. You will bridge high-level strategy and hands-on execution by architecting robust systems, leading a team of engineers, and transforming complex business challenges into scalable products. Your daily responsibilities include building multi-agent AI systems, orchestrating tool-calling frameworks, and developing RAG pipelines. You will utilize Python, AWS, Azure, or Google Cloud, alongside frameworks like LangChain, LlamaIndex, and LangGraph. Key technical tasks involve fine-tuning open-source models, managing vector databases, and implementing LLMOps for monitoring and cost tracking. This role operates within a highly regulated financial services environment, requiring navigation of strict security protocols to deliver production-ready AI applications.

What does a Software Engineering Manager earn?

Median $214394 from 123 postings across 39 companies.

See salary data

What you'll do

  • Architect and design scalable, secure, production-ready GenAI applications using LLMs and RAG pipelines.
  • Build and orchestrate multi-agent AI systems and tool-calling frameworks like LangChain and LangGraph.
  • Lead a team of engineers by conducting code reviews, establishing best practices, and mentoring junior staff.
  • Rapidly develop Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) to test emerging AI models.
  • Implement LLMOps including monitoring, caching, prompt versioning, cost tracking, and evaluation guardrails.
  • Fine-tune and deploy open-source models to meet specific business requirements and security protocols.
  • Partner with product managers and data scientists to align technical deliverables with organizational goals.

What we're looking for

  • 7+ years of relevant experience or an equivalent combination of education and experience.
  • Bachelor’s Degree in a relevant field or equivalent.
  • Software engineering experience.
  • 5+ years of machine learning engineering experience.
  • 2+ years of hands-on experience building and deploying GenAI/LLM enterprise applications.
  • Advanced proficiency in Python and cloud-native development (AWS, Azure, or Google Cloud).
  • Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries like LangChain or LlamaIndex.
  • Experience fine-tuning open-weight foundation models.

More like this

Similar roles

Gen AI Lead

Cognizant

Tarrytown, NY 11 days ago $81,337–$141,500
LangChain LangGraph AutoGen CrewAI Semantic Kernel Python RAG Vector Databases Claude OpenAI GPT Gemini AWS Azure GCP Docker Kubernetes CI/CD Prompt Engineering Model Context Protocol (MCP) AI Evaluation Frameworks
8+ yrs exp Hybrid

Gen AI Lead

Cognizant

Tarrytown, NY 11 days ago $81,337–$141,500
LangChain LangGraph AutoGen CrewAI Semantic Kernel Python RAG Vector Databases Docker Kubernetes AWS Azure GCP CI/CD Prompt Engineering Claude OpenAI GPT Gemini Model Context Protocol (MCP)
8+ yrs exp Hybrid

Software Engineering Manager

The Hartford

Charlotte, NC +1 66 days ago
Java J2EE AWS Angular Open Shift Oracle SQL Server REST SOAP micro services DevOps GitHub Jenkins SonarQube Rally Agile SAFe JSON XML JDBC JMS JSP
10+ yrs exp Hybrid

Manager, Software Engineering

Circle

Remote (San Francisco, CA) +24 42 days ago $195,000–$257,500
Go Java JavaScript Agile Scrum Technical Leadership
7+ yrs exp Remote

Manager, Software Engineering

Snap Inc.

Bellevue, WA +4 103 days ago $229,000–$343,000
AI Tools Distributed Systems Web Development Scalable Services Ops-heavy Systems Security
9+ yrs exp Hybrid

Manager, Software Engineering

Mastercard

O Fallon, MO 47 days ago $140,000–$231,000
Java C++ Distributed Systems Microservices Event-Driven Architecture API Design CI/CD Unit Testing Integration Testing Performance Engineering Observability Site Reliability Engineering DevOps Threat Modeling Data Structures Algorithms Secure Coding Logging Monitoring Benchmarking