Senior Software Engineer, Machine Learning Platform

What you'll do

• Design, build, and operate scalable machine learning and AI infrastructure on AWS.
• Develop shared platform capabilities for LLM and agentic workloads, including model access and workflow orchestration.
• Build evaluation frameworks for non-deterministic AI systems using offline benchmarks and online quality signals.
• Establish observability, reliability, and governance for models, covering latency, token usage, and safety.
• Build distributed training and large-scale processing systems using frameworks like Ray or Spark.
• Maintain infrastructure as code using Terraform and manage CI/CD workflows for ML models.
• Support and evolve the feature store, feature pipelines, and data streaming systems.
• Participate in on-call rotations to support production systems.

What we're looking for

• 5+ years of experience in ML or AI infrastructure, platform engineering, distributed systems, or production ML systems.
• Strong programming skills in Python, Go, Scala, Java, or similar languages.
• Experience designing distributed systems and large-scale data or compute platforms on AWS using frameworks such as Spark or Ray.
• Knowledge of the machine learning development lifecycle, including data preprocessing, model training, evaluation, deployment, and monitoring.
• Working knowledge of LLM application patterns such as RAG, structured outputs, tool calling, and agent orchestration.
• Experience with containerization and orchestration technologies such as Docker and Kubernetes.
• Hands-on experience with CI/CD pipelines, DevOps practices, and infrastructure as code using Terraform.
• Experience shipping LLM-powered or agentic systems to production (preferred).