Senior Solutions Architect, Generative AI Deployment and AIOps

What you'll do

• Define high-value technical solutions based on customer strategies and technical needs.
• Engage with developers, scientific researchers, and data scientists across various technical areas.
• Partner with lighthouse customers to build creative solutions using NVIDIA technology and MLOps.
• Analyze the performance and power efficiency of AI inference workloads on Kubernetes.
• Perform performance analysis and modeling of inference software with internal teams.
• Execute projects and proof-of-concepts focused on inference for Generative AI and LLMs.
• Provide technical advice on GPU orchestration and Multi-Instance GPU management.

What we're looking for

• BS, MS, or PhD in Computer Science, Engineering, Mathematics, or a related field (or equivalent experience).
• 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow.
• Strong fundamentals in programming, optimizations, and software design, especially in Python.
• Proficiency in problem-solving and debugging for GPU orchestration and Multi-Instance GPU management within Kubernetes.
• Experience with containerization, orchestration technologies, monitoring, and observability solutions for AI deployments.
• Excellent knowledge of the theory and practice of LLM and DL inference.
• Excellent presentation, communication, and collaboration skills.
• Prior experience with DL training at scale, deploying or optimizing DL inference in production (preferred).