Senior Software Engineer, AI Frameworks

What you'll do

• Design and implement end-to-end integrations of Grove with open-source AI frameworks like PyTorch, Ray, and Dynamo.
• Build and maintain adapters, plugins, and runtime components to enable Grove features across training and inference stacks.
• Partner with framework owners to upstream changes and ensure long-term maintainability of integrated systems.
• Develop reference workflows, sample applications, and best-practice guides to accelerate user adoption.
• Optimize performance, scalability, and reliability for distributed training and inference in multi-node and multi-GPU environments.
• Improve observability and operational readiness for Kubernetes-based deployments through metrics, logging, and tracing tools.
• Diagnose complex issues involving containers, networking, scheduling, and CUDA/GPU utilization.
• Define APIs and contracts to ensure compatibility across various versions of frameworks and dependencies.

What we're looking for

• BS/MS/PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience).
• 5+ years of proven experience in a related field.
• Hands-on experience integrating with at least one major AI framework or runtime like PyTorch, Ray, or Triton Inference Server.
• Solid understanding of AI workloads including model development, training vs. inference tradeoffs, and performance considerations.
• Experience with distributed systems concepts such as RPC, scheduling, fault tolerance, and resource management.
• Practical experience in Kubernetes, including deploying services, Helm/Kustomize, and debugging clusters.
• Strong software engineering experience in Go, C++, and/or Python to ship reliable systems.
• Open-source contributions to Dynamo, PyTorch, Ray, or the Kubernetes ecosystem (preferred).