Principal Software Engineer, AI Frameworks

What you'll do

• Define technical vision, architecture, and multi-release strategies for AI frameworks and performance capabilities.
• Lead cross-stack investigations involving models, compilers, runtimes, systems, and silicon.
• Create automated measurement and observability mechanisms to turn one-off analyses into scalable platform features.
• Improve model onboarding velocity, runtime performance, reliability, and hardware utilization.
• Align researchers, product groups, and hardware partners around technical decisions and execution plans.
• Provide hands-on leadership through prototyping, critical-path implementation, and complex debugging.
• Mentor engineers and develop technical leaders to improve code quality and maintainability.

What we're looking for

• Bachelor's Degree in Computer Science or a related technical field.
• 6+ years of technical engineering experience coding in languages such as C++ or Python (or equivalent experience).
• Ability to pass Microsoft Cloud background checks and other required security screenings.
• Deep expertise in GPU or accelerator programming, compilation, and low-level execution (preferred).
• Expertise in parallelism strategies for LLM training and inference (preferred).
• Expertise in distributed inference acceleration and understanding of LLM serving architectures like vLLM or SGLang (preferred).
• Demonstrated leadership of cross-team technical initiatives from strategy through production impact (preferred).
• Track record of creating reusable platforms, influencing stakeholders, and mentoring engineers (preferred).