Cloud Services Software Engineer

What you'll do

• Develop solutions at the intersection of machine learning, distributed systems, and high-performance computing.
• Design and optimize micro-services orchestrated by Kubernetes for large-scale AI training workflows.
• Co-design and implement APIs to integrate services with telemetry, break/fix automation, and checkpoint systems.
• Craft a submission abstraction to hide infrastructure complexity and handle job lifecycles with auto-restarts.
• Build modular services that can be deployed onto both on-premises AI clusters and cloud services.
• Ensure high resiliency and efficiency for AI training supercomputers located at major CSPs.

What we're looking for

• Bachelor's degree or higher in Computer Science or a related technical field, or equivalent experience.
• 5+ years of hands-on experience in backend development.
• Proficiency in high-performance languages such as Python, Go, or C/C++.
• Proven track record of building and scaling large-scale distributed systems.
• Experience with cloud platforms (AWS, Azure, GCP), container technologies (Docker, Kubernetes), and HPC/AI platforms like Slurm.
• Experience in DL frameworks such as PyTorch, TensorFlow, JAX, and Ray (preferred).
• Experience developing a framework plugin architecture for cluster scheduler integration (preferred).
• Strong understanding of NVIDIA GPUs, network technologies, and failure patterns (preferred).