Senior Core Infrastructure Engineer

What you'll do

• Design and develop scalable validation frameworks for GPU racks and HPC infrastructure.
• Build automated benchmarks and diagnostics for NCCL performance, GPU health, and high-speed networks.
• Develop Slurm-based workflows for distributed validation and performance testing.
• Build dashboards, telemetry, and alerts to monitor infrastructure health and validation results.
• Develop automated tools for Linux diagnostics, log analysis, and hardware fault isolation.
• Create and maintain Bash, Python, and Infrastructure as Code tools for deployment and configuration.
• Implement access controls and secure handling of infrastructure credentials and diagnostic data.
• Author recovery runbooks and participate in incident response and root cause investigations.

What we're looking for

• Applicants must be able to read, write, and speak English.
• 3 to 5+ years of experience is required.
• Experience with Oracle Cloud Infrastructure (OCI) is required.
• Experience designing and optimizing components in distributed systems for scalability and resiliency is required.
• Proficiency in developing automation and Infrastructure as Code (IaC) tools using Bash and Python is required.
• Experience building automated benchmarks and diagnostics for GPU racks, HPC infrastructure, and high-speed networks is required.
• Experience developing Slurm-based workflows for distributed validation and performance testing is required.
• Experience implementing security controls, encryption, and access management for infrastructure is required.