Lead Infrastructure Developer

What you'll do

• Own GPU fleet operations across the AWS estate, including capacity, scheduling, and diagnostics.
• Build a GPU scheduling layer from the ground up.
• Diagnose GPU and node failures and manage hardware replacements through AWS support channels.
• Provide researcher support through office hours, support channels, and self-service tooling.
• Instrument the fleet to track utilization, queue depth, job success rates, and cost metrics.
• Act as the technical contact for external compute partnerships and internal infrastructure groups.
• Author runbooks, decision records, and onboarding documentation.

What we're looking for

• 8+ years of experience operating production infrastructure with deep, hands-on AWS depth.
• Experience scheduling, diagnosing, and managing GPUs in AWS specifically.
• Experience operating GPU fleets at 1000+ GPU scale.
• Expertise in scripting and automation with Python, PowerShell, bash, or equivalent.
• Expertise in infrastructure as code using Terraform or equivalent.
• Familiarity with a GPU scheduling or orchestration layer such as Slurm, Kubernetes with Kueue or Volcano, Ray, dStack, or SkyPilot.
• Observability practice including Grafana, Prometheus, or equivalent.