AI Gateway Engineer

Allstate

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
IL
Salary
$100,000–$170,500 / yr
Employment
Full-time
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $192k
This role $135k
$84k $248k
below market most similar roles pay here above market

This role pays less than 88% of similar roles. Most pay $152,568–$231,862 — the blue band above. At the midpoint, this role pays about $135k versus about $192k for comparable roles.

Based on 240 similar postings.

Employer

About Allstate

The Allstate Corporation is one of the largest publicly held personal lines insurers in the US, widely recognized for its "You're In Good Hands With Allstate®" slogan.

Allstate currently has 53 open roles on FindRole.

Listed pay typically runs $100,000–$170,500 across 52 roles with salary data.

Most-posted roles

View all roles at Allstate

At a glance

TL;DR · AI Gateway Engineer

The Software Engineer Lead Consultant will serve as a technical lead focused on the Kong AI Gateway. This role involves architecting, designing, building, testing, and supporting modern digital products while owning applications through production to meet key performance goals. You will design enterprise-grade AI Gateway solutions, configure AI-specific policies like prompt logging and content filtering, and enable secure access to multiple LLM providers. Key responsibilities include implementing AI observability, token analytics, and cost governance while developing routing strategies for various models. You will utilize Kong Gateway, Kong Konnect, Kubernetes, Docker, Helm, and CI/CD tools like Jenkins and GitHub Actions. Technical requirements include experience with OpenAI, Azure OpenAI, GraphQL, OAuth2, and RAG architecture concepts to solve complex enterprise AI enablement and governance problems.

What you'll do

  • Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
  • Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.
  • Enable secure access to multiple LLM providers through a unified gateway architecture.
  • Implement AI observability, token analytics, usage tracking, and cost governance.
  • Develop routing strategies across multiple AI models based on latency, cost, and availability.
  • Integrate RAG-based AI services through secure API management frameworks.
  • Deploy and manage Kong in Kubernetes-based environments.
  • Automate deployments and operational processes using DevOps tools.

What we're looking for

  • 8 plus years of experience in API Management, Middleware, or Platform Engineering.
  • 3 to 5 years of hands-on experience with Kong Gateway Administration.
  • Experience with cloud-native and microservices architectures (preferred).
  • Proficiency in Kong Gateway (OSS/Enterprise), Kong Konnect, and AI Gateway/LLM Proxy development.
  • Expertise in OpenAI/Azure OpenAI integration, REST APIs, GraphQL, OAuth2, JWT, and OIDC.
  • Experience with Kubernetes, Docker, Helm, and CI/CD tools like Jenkins, GitHub Actions, or Azure DevOps.
  • Knowledge of AI architecture, LLM guardrails, RAG, vector databases, and LLMOps.
  • Ability to work Central Time or Eastern Time hours.

More like this

Similar roles

Gateway Site Development Engineer

SpaceX

Redmond, WA 148 days ago $95,000–$115,000
Hardware Design Structural Design SQL Matlab Python C++ Tableau PowerBI Construction Drawings Physical Network Infrastructure
1+ yrs exp

Distinguished AI Engineer, Agentic AI Platform

Capital One Financial

Remote (San Francisco, CA) +4 95 days ago
Python Go Scala Java C++ C# LangGraph AutoGen Semantic Kernel CrewAI LlamaIndex LangChain LLMOps AWS Google Cloud Vertex AI Azure Machine Learning Helm VectorDB RAG
8+ yrs exp Remote

Software Engineer

Cloudflare, Inc

Austin, TX +1 66 days ago
Rust TypeScript Go Kubernetes Cloudflare Workers S3 API Distributed Systems Edge Computing Object Storage API Gateway HTTP Monitoring Alerting Performance Tuning Incident Response Durable Objects
3+ yrs exp Hybrid

Senior Agentic AI Engineer

Cognizant

Remote 7 days ago $100,000–$130,000
Amazon Bedrock Agentic AI AWS Lex AWS Lambda DynamoDB S3 API Gateway IAM CloudWatch RAG Prompt Engineering NLU LLM GitHub Copilot ChatGPT Claude Cursor
Remote

Senior Distinguished AI Engineer, Agentic AI Platform

Capital One Financial

Remote (San Francisco, CA) +4 105 days ago
Python Go Scala Java C++ C# LangGraph AutoGen Semantic Kernel CrewAI LlamaIndex LangChain LLMOps AWS Google Cloud Azure Helm VectorDB RAG Machine Learning
10+ yrs exp Remote