Software Engineer III, Machine Learning Platform

What you'll do

• Design, build, and maintain an end-to-end ML training platform.
• Run and optimize GPU training workloads for improved throughput and reproducibility.
• Build and operate training infrastructure on Kubernetes platforms like EKS.
• Enable Gen AI and LLM training workflows including fine-tuning and evaluation harnesses.
• Implement observability for training systems using metrics, logs, dashboards, and alerting.
• Improve developer experience through standardized containers, CI/CD, and self-service workflows.
• Optimize training costs and performance through right-sizing and scheduling policies.

What we're looking for

• Formal training or certification on software engineering concepts and 3+ years of applied experience.
• Demonstrated experience running ML training in cloud environments and debugging issues across infrastructure and code.
• Strong Python skills with solid engineering practices including testing, code reviews, modular design, and dependency management.
• Hands-on experience with deep learning training workflows and at least one major framework such as PyTorch or TensorFlow.
• Experience with Kubernetes fundamentals for compute-intensive workloads and AWS services like EKS, S3, IAM, and VPC.
• Experience with distributed training concepts including DDP, FSDP, DeepSpeed, and collective communication basics.
• Hands-on experience using enterprise-authorized AI-assisted software development tools to create, validate, and refine code.
• Experience running training workloads across multiple cloud platforms (preferred).