Senior Software Quality Engineer, Agentic Harness

What you'll do

• Design, write, and maintain automated test suites for the agentic harness.
• Create test plans to verify agent behavior, tool use, and outputs.
• Perform manual and exploratory testing to identify edge cases and failure modes.
• Investigate test failures and reported bugs to isolate and document root causes.
• Partner with the Agent Evals team to close coverage gaps and improve quality signals.
• Verify that agentic systems meet quality and reliability standards before production release.

What we're looking for

• Bachelor’s degree in Computer Science or a related field, or equivalent experience.
• Several years of experience in quality engineering, test automation, or QA.
• Hands-on experience writing automated tests and test frameworks.
• Solid grasp of test design fundamentals, including coverage, edge cases, and regression risk.
• Comfort digging into bugs and failures across a stack to identify root cause.
• Familiarity with testing LLM-based or agentic systems and how their behavior differs from traditional software.
• Comfort operating in a fast-moving, ambiguous environment where technology and user expectations are evolving quickly.