Senior Machine Learning Services Engineer

What you'll do

• Design and operate backend cloud services for ML and Generative AI features.
• Architect GPU-accelerated ML inference pipelines for scalability and efficiency.
• Optimize ML models for production, enhancing latency, throughput, and cost.
• Analyze and improve performance of end-to-end AI workflows for reliability.
• Lead integration of new ML models into production systems with validation.

What we're looking for

• 5+ years of experience building, optimizing, and operating ML systems in production.
• Proven expertise in designing large-scale cloud services with strong performance requirements.
• Strong background in model serving and inference optimization techniques.
• Hands-on experience with computer vision and generative models like GANs and diffusion models.
• Proficiency in Python, PyTorch, TensorFlow, NVIDIA Triton, Docker, Kubernetes, AWS.
• Solid understanding of GPU systems, drivers, and deployment considerations in cloud environments.
• Ability to work independently on complex systems while collaborating effectively across teams.