Staff Software Engineer, AI Developer Experience

What you'll do

• Design, build, and operate foundational components of the AI Gateway, model routing, and evaluation platforms.
• Develop usage telemetry, cost allocation, and chargeback mechanisms to provide visibility into AI spend.
• Plan feature architecture, parallelize work streams, and align cross-team dependencies with product leaders.
• Define coding conventions, automated patterns, and architectural standards for maintainable software.
• Automate build, test, and deployment workflows while serving as a lead resolver for production incidents.
• Maintain a 6-to-12-month technical vision for system growth and architectural hygiene.
• Partner with internal engineering teams to understand developer workflows and drive adoption of coding tools.
• Provide constructive code and design feedback to mentor and develop team members.

What we're looking for

• Bachelor’s Degree plus 3–4 years of experience or a Master’s Degree plus 2–3 years of experience in software engineering or a related field.
• Advanced programming expertise in at least one modern backend language such as Java, Kotlin, Python, Go, or Scala.
• Proven expertise in distributed systems including security, concurrency, fault tolerance, horizontal scaling, and idempotence.
• Track record of technical leadership guiding feature delivery, cross-functional alignment, and architecture on production platforms.
• Hands-on experience developing AI-assisted developer tooling and LLM-based systems like coding assistants or autonomous agents.
• Hands-on experience with cloud infrastructure (AWS/GCP), containerization, modern CI/CD pipelines, and operational on-call service ownership.
• Clear written and verbal communication skills to draft structured technical design documents and present options to stakeholders.
• Direct experience building LLM evaluation pipelines, model proxies, or semantic request routing layers (preferred).