Software Engineer Manager, Agentic Evaluation Platform

What you'll do

• Lead and grow a team of engineers building backend services, compute orchestration, and evaluation harnesses.
• Define the technical direction and roadmap for the evaluation platform while ensuring timely delivery.
• Manage backend services and APIs that provide evaluation as a scalable platform capability.
• Oversee compute orchestration across heterogeneous device and host fleets to manage capacity and throughput.
• Develop harness engineering layers to drive devices and models through evaluation runs.
• Design and steward data workflows for results scoring, storage, and reporting.
• Establish high standards for system diagnosability and automated triage across the entire stack.
• Recruit, mentor, and develop a team of engineers with a focus on technical depth and ownership.

What we're looking for

• Must have 5+ years of experience developing production software using languages such as Python, Java, Go, or Swift.
• Must have 3+ years of engineering management experience including roadmap ownership, mentoring, and providing feedback.
• Must possess a B.S. or M.S. in Computer Science, Machine Learning, or a related field, or equivalent experience.
• Must demonstrate strong technical leadership to set architectural direction and inspire a team.
• Must have experience with test infrastructure, CI/CD, or evaluation/ML platforms.
• Must possess excellent spoken and written communication skills for cross-team collaboration.
• Experience building or leading teams applying LLMs or AI agents to engineering workflows (preferred).
• Depth in distributed systems, cloud infrastructure, data platforms, or large-scale test infrastructure (preferred).