Senior Software Engineer, Agent Simulation and Evaluation

What you'll do

• Build agentic systems to automate simulation, evaluation, performance analysis, and reporting.
• Develop tools to configure experiments, run evaluations, and identify regressions.
• Analyze inference characteristics of LLMs, reasoning models, coding agents, and multimodal models.
• Build and validate performance models for GPU, LPU, and heterogeneous hardware systems.
• Automate critical workflows including benchmarking, workload characterization, and capacity planning.
• Develop tools to recommend follow-up work based on analyzed evaluation results.
• Improve simulation quality and accelerate engineering decisions across hardware and software teams.

What we're looking for

• MS in Computer Science, Engineering, or a related field, or equivalent experience.
• 5+ years of relevant software development experience.
• 2 years of experience building AI agents or building AI-backed engineering systems.
• Strong Python skills and experience building reliable engineering tools.
• Experience with simulation, profiling, benchmarking, or performance modeling.
• Familiarity with modern model architectures and AI inference workloads.
• Experience evaluating AI models or agents and analyzing performance.
• Knowledge of GPU/accelerator architecture, distributed inference, or high-performance computing (preferred).