Engineering Manager, Inference Benchmarking

What you'll do

• Drive the technical roadmap for AIPerf's core infrastructure including load generation and GPU telemetry.
• Ensure the accuracy and statistical soundness of benchmark results used by industry engineering groups.
• Advise on upstream engine integrations with vLLM, TRT-LLM, and SGLang to maintain platform relevance.
• Hire, mentor, and grow a team of senior engineers in a high-velocity open-source environment.
• Manage the development of benchmarking tools for LLM, multimodal, diffusion, and computer vision inference.
• Oversee Kubernetes-native infrastructure deployments including operators and GPU observability tooling.
• Lead technical strategy to establish AIPerf as the primary standard for datacenter, local, and edge use cases.

What we're looking for

• Bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
• Software engineering experience building performance-critical infrastructure, ML tooling, or distributed systems.
• 3+ years of engineering leadership experience as a tech lead, TLM, or engineering manager.
• Deep understanding of LLM inference mechanics including TTFT, ITL, KV caching, and speculative decoding.
• Ability to ensure measurement correctness and reproducibility for benchmark results.
• Proven track record of collaborating across multi-functional groups in high-velocity, high-visibility environments.
• Experience with vLLM, TRT-LLM, or SGLang internals and contributions to their upstream projects.
• Experience building Kubernetes-native infrastructure including operators, Helm charts, and GPU observability tooling.