Model Operations Lead, AI Gateway

Cloudflare, Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Austin, TXNew York, NYSan Francisco, CA
Salary
$230,000–$317,000 / yr
Posted
4 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $200k
This role $274k
$127k $337k
below market most similar roles pay here above market

This role pays more than 89% of similar roles. Most pay $163,003–$237,000 — the blue band above. At the midpoint, this role pays about $274k versus about $200k for comparable roles.

Based on 240 similar postings.

Employer

About Cloudflare, Inc

Cloudflare is a prominent cloud services and security company that provides content delivery network (CDN), DDoS mitigation, and Zero Trust security services to millions of internet properties.

Cloudflare, Inc currently has 106 open roles on FindRole.

Listed pay typically runs $194,000–$257,000 across 59 roles with salary data.

Most-posted roles

View all roles at Cloudflare, Inc

At a glance

TL;DR · Model Operations Lead, AI Gateway

The Model Operations Lead, AI Gateway, is a people-management role reporting to the AI Gateway Engineering Manager. You will lead, hire, and develop the models team to manage the AI Gateway catalog and build model intelligence. Responsibilities include running end-to-end model launches, coordinating provider integrations, performing capability testing, and managing pricing, metering, and security reviews. You will also build auto-routing profiles, capability maps, and regression detection systems. The role requires hands-on technical skills in TypeScript, Python, or Rust, along with experience using terminal tools like cURL and logs. You must possess deep expertise in the model ecosystem, including streaming, tool calling, and token pricing. This role solves the challenge of providing reliable, observable, and cost-effective AI inference at the network edge for developers.

What you'll do

  • Hire, coach, and lead the models team to manage the AI Gateway catalog and intelligence.
  • Execute end-to-end model launches including provider integrations, capability testing, pricing, and security reviews.
  • Maintain catalog accuracy by identifying silent regressions in tool calling, pricing, and model behavior.
  • Develop model intelligence through evals, capability maps, and per-task rankings for auto-routing profiles.
  • Manage the product roadmap for the catalog based on usage, quality, reliability, and cost data.
  • Automate repeatable tasks like endpoint validation, eval runs, and pricing reconciliation using scripts and agent workflows.
  • Coordinate with Engineering, Product, and Partnerships stakeholders to align on project status and blockers.
  • Write code and debug using terminal tools to support hands-on technical requirements and failed launch investigations.

What we're looking for

  • Experience hiring, managing, and growing engineers or operators while providing direct feedback and delegating ownership (preferred).
  • Proven track record of taking technical launches or integrations from ambiguity to production across teams and partners (preferred).
  • Hands-on ability to write TypeScript, Python, or Rust, read API docs, and debug using terminal tools (preferred).
  • Deep familiarity with new models, inference providers, streaming, tool calling, and provider-specific model behaviors (preferred).
  • Data-driven product instincts and an SRE approach to defining and alerting on service health (preferred).
  • Daily experience building with agents, including scoping work and verifying outputs (preferred).
  • Experience at an inference provider, model lab, model router, eval platform, or API company (preferred).
  • Export control laws, including the U.S. Export Administration Regulations.

More like this

Similar roles

Senior Systems Engineer, AI Gateway

Cloudflare, Inc

Austin, TX +1 100 days ago $194,000–$266,000
AI Infrastructure Distributed Systems APIs TypeScript Go Rust Workers AI AI Gateway LLM Proxy Observability SDKs Data Modeling Networking Caching
5+ yrs exp

IAM Operations Lead

Booz Allen Hamilton

Reston, VA +2 84 days ago
PKI Active Directory Certificate Services Certificate Authority Keyfactor Venafi Linux ACME SCEP Asymmetric Cryptography Certificate Lifecycle Management Incident Response Patching Configuration Management Scripting Security+
3+ yrs exp

Lead, IAM Automation & Strategy

Northern Trust

Chicago, IL +1 99 days ago $99,600–$169,200
Identity & Access Management (IAM) Tines Automation Engineering APIs Web Services Digital Coworker AI-enabled automation Cyber Security Software Development Process Optimization Data Analysis Ticketing Systems
5+ yrs exp

AI Operations Engineering Technical Leader

Cisco

Milpitas, CA 91 days ago
Kubernetes Docker Terraform Python Go Bash CI/CD AWS Azure GCP Helm GitOps Jenkins GitHub ArgoCD Infrastructure as Code AIOps Microservices
8+ yrs exp Hybrid

AI Model Governance & Monitoring Lead

USAA

San Antonio, TX +4 18 days ago $164,780–$314,960
AI Governance Model Risk Management Data Governance NIST AI Risk Management Framework Data Management Data Quality Data Lineage Data Privacy GLBA CCPA/CPRA GDPR Access Management Information Governance Root Cause Analysis
8+ yrs exp Hybrid