Staff Software Engineer, AI Platform

What you'll do

• Own significant parts of the platform end-to-end, from API design to production performance.
• Design the model gateway to handle provider abstraction, routing, and failover configurations.
• Build evaluation and benchmarking capabilities for the platform from scratch.
• Design and implement code-enforceable guardrails for safe agent production deployment.
• Manage inference costs and latency as first-class engineering concerns including spend attribution.
• Create a standardized agent surface that works across different frameworks and environments.
• Establish observability standards and provide technical mentorship to a distributed engineering team.

What we're looking for

• 8+ years of experience building and operating production systems.
• Direct experience shipping production agentic systems including retrieval, tool calling, and inference cost management.
• Hands-on experience with multiple model providers and their practical differences.
• Experience with evaluation, observability, or guardrail tooling for agentic systems.
• Strong platform engineering track record building systems for other engineering teams.
• Hands-on depth in at least one major public cloud for running and debugging production workloads.
• Experience designing stable APIs and abstractions for other teams to build against.
• Demonstrable production ownership including on-call, incident response, and root cause analysis.
• Excellent written and spoken English communication skills.
• Built or operated an internal developer platform or shared multi-tenant service (preferred).
• Experience with Kubernetes, container-based delivery, and infrastructure as code (preferred).
• Knowledge of enterprise security, data privacy, or responsible-AI review processes (preferred).