Senior Software Engineer, CUDA Deep Learning Systems

What you'll do

• Research and prototype novel system optimizations at the intersection of deep learning frameworks and CUDA.
• Architect and optimize distributed computing systems that scale from single nodes to large supercomputing clusters.
• Design and implement custom high-performance CUDA kernels for emerging neural network architectures.
• Analyze hardware-software interactions to identify and resolve performance bottlenecks in training and inference pipelines.
• Develop exploratory tools and runtime systems to profile and accelerate new deep learning paradigms.
• Write maintainable code for prototypes intended for open-source release, framework integration, or commercial products.

What we're looking for

• BS, MS, or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• 8+ years of relevant industry experience or equivalent academic experience after degree achievement.
• Strong proficiency in C++ and Python programming.
• Solid background in deep learning fundamentals with a focus on transformers.
• Strong understanding of distributed computing principles, multi-node scaling, and cluster-scale execution performance challenges.
• Proven experience in systems programming, computer architecture, and low-level systems performance optimization.
• Hands-on experience with CUDA programming, kernel optimization, and workload profiling on GPU architectures.
• Experience profiling and optimizing generative AI models, including large language models, vision models, or diffusion models.