| Microsoft Careers

Microsoft

Quick summary

Work type: On-site
Location: Redmond, WA
Salary: $119,800–$234,700 / yr
Posted: 49 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $181k

This role $177k

$106k most similar roles pay here $248k

This role pays more than 59% of similar roles. Most pay $155,000–$207,350 — the shaded band above. At the midpoint, this role pays about $177k versus about $181k for comparable roles.

Based on 238 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 1103 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 985 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · | Microsoft Careers

Apply Now Log in to save

As a Senior Software Engineer on the Artificial Intelligence Performance team at Microsoft, you will work on optimizing the inference performance of large language models (LLMs) such as those from OpenAI across diverse hardware platforms, including GPUs and custom silicon. Your daily tasks will involve benchmarking model performance, identifying bottlenecks, and developing software tools to enhance deployment efficiency and reduce computational costs. You will collaborate closely with internal teams and external partners to ensure rapid integration of new models while maintaining high standards for customer experience. The role requires expertise in languages like C++, Python, and familiarity with GPU architectures and profiling tools, as well as a strong background in computer science principles and software engineering practices.

Skills

Python C++ CUDA NVIDIA_GPU AMD_GPU Linux Performance_Optimization Benchmarking CI/CD Cloud_Computing Azure OpenAI_API LLM_Models GPU_Profiling_Tools SW_Tooling Computer_Architecture Collaboration_Techniques

What you'll do

Measure and benchmark performance of OpenAI and other LLM models on GPUs.
Optimize and monitor the performance of large language models across various hardware.
Develop software tooling to provide insights into performance opportunities at multiple levels.
Design, implement, and test functions for AI/DNN/LLM frameworks and tools.
Reduce complexity in key components/pipelines to enhance system efficiency and performance.

What we're looking for

4+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python
Bachelor’s degree in computer science or related field
Experience in end-to-end performance analysis and optimization of state-of-the-art LLMs
Proficiency using GPU profiling tools for performance optimization
Solid foundation in software engineering principles and computer architecture
Technical background in GPU architecture and hardware neural net acceleration

Similar roles

| Microsoft Careers

Microsoft

US 97 days ago $88,000–$150,100

Azure AI Sales methodologies CI/CD Power Platform Market intelligence tools Cloud Native Data Platform Analytics Kubernetes Python PostgreSQL AWS Grafana

Hybrid

Save

| Microsoft Careers

Microsoft

Redmond, WA +2 58 days ago $142,800–$274,800

Azure Kubernetes Docker CI/CD Python PostgreSQL Terraform Prometheus Grafana Git Jira Swagger RESTful APIs JSON YAML DevOps Scrum Agile

Hybrid

Save

| Microsoft Careers

Microsoft

US 57 days ago $102,100–$202,200

Intune Microsoft Azure Windows 11 iOS Android SCIM Terraform Docker CI/CD Kubernetes PostgreSQL Python Prometheus Grafana AI Agentic AI

Save

| Microsoft Careers

Microsoft

WA 76 days ago $119,800–$234,700

Python TypeScript Golang Java C# Scala Rust React Next.js AI/ML systems C#/Java Model pretraining Post training Evaluation Inference CI/CD

Save

| Microsoft Careers

Microsoft

Redmond, WA 51 days ago

Python TensorFlow PyTorch DeepLearning ComputerVision SelfSupervisedLearning MixtureOfExperts DenseVisionProblems CVPR NeurIPS ICML ICCV ECCV AAAI IJCAI 3DV IEEETransactions ACMTransactions IJCV

Save

| Microsoft Careers

Microsoft

US 28 days ago $130,900–$251,900

AI Cloud Security CI/CD Data Protection Model Protection Runtime Monitoring Agent Security Market Trends Competitive Intelligence Vendor Analysis Technical Communication Cybersecurity AI Governance Risk Management Product Marketing Strategic Market Analysis

Save