| Microsoft Careers

Microsoft

Quick summary

Work type
On-site
Location
—
Salary
$142,800–$274,800 / yr
Posted
58 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $180k
This role $209k
$101k most similar roles pay here $293k

This role pays more than 95% of similar roles. Most pay $152,150–$207,350 — the shaded band above. At the midpoint, this role pays about $209k versus about $180k for comparable roles.

Based on 239 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 1580 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 1408 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · | Microsoft Careers

Apply Now Log in to save

As a Principal Software Engineer in the CoreAI team at Microsoft Azure, you will play a pivotal role in developing and scaling the AI data-plane that powers large language model (LLM) inferencing for both internal and external customers. Your day-to-day responsibilities include building core serving systems, implementing smart request routing, and collaborating on cutting-edge innovations with industry leaders. You will also design and deliver high-performance AI services, mentor team members through code reviews and design sessions, and engage directly with customers to gather feedback and resolve complex issues. The role requires expertise in languages such as C++, Java, and experience with distributed systems, high-performance storage, and global-scale infrastructures. This position offers a unique opportunity to contribute to one of the fastest-growing services at Microsoft, driving significant industry impact through reliable, efficient AI solutions.

Skills

C++ Java Python Kubernetes Docker CI/CD AWS Azure PostgreSQL Redis Prometheus Grafana GraphQL RESTful APIs Scalability Distributed Systems High Performance Computing Networking Observability Latency Optimization

What you'll do

  • Build and scale core serving systems for various LLMs like OpenAI and Mistral.
  • Design and implement AI services supporting large-scale LLM product offerings.
  • Innovate technical solutions to enhance availability, reliability, and performance of products.
  • Coach team members through design reviews and mentorship, leading by example.
  • Engage with customers to gather feedback and resolve complex issues efficiently.

What we're looking for

  • 6+ years of experience in software engineering with proficiency in C, C++, C#, or Java.
  • Strong understanding of system performance, scalability, and distributed systems at scale.
  • Experience in designing high-performance storage, distributed databases, and networking solutions.
  • Ability to lead complex technical initiatives across multiple teams and disciplines.
  • Customer-focused approach with empathy and a drive to deliver impactful solutions.

Related searches

More | Microsoft Careers jobs All jobs at Microsoft

More like this

Similar roles

| Microsoft Careers

Microsoft

US 63 days ago $142,800–$274,800
Python JavaScript C++ Java Kubernetes AWS Azure Docker CI/CD PostgreSQL MongoDB Redis Apache Spark TensorFlow PyTorch Prometheus Grafana Git Jenkins Responsible AI Scikit-learn
Hybrid
Save

| Microsoft Careers

Microsoft

Redmond, WA 12 days ago $142,800–$274,800
Python MATLAB RF measurement time-domain control AI ML automation tools topological qubits spin qubits superconducting qubits quantum characterization verification validation data acquisition statistical analysis cryogenic electrical measurements
Save

| Microsoft Careers

Microsoft

Redmond, WA 51 days ago $142,800–$274,800
Python TensorFlow PyTorch Kubernetes Docker CI/CD PostgreSQL MongoDB AWS Azure NLP Multimodal_Models Fine_Tuning Reinforcement_Learning A/B_Testing Predictive_Analytics Statistical_Methodologies ACL EMNLP SIGKDD AAAI WSDM COLING WWW ICASSP
Save

| Microsoft Careers

Microsoft

Redmond, WA 53 days ago $127,600–$229,200
UPS Generator AHU Servers SANs Networking Rack/Enclosures Structured Cabling CompTIA ITIL v3 Foundation MOF Certifications PMP CDCP CCNA Certifications ASICS/Inventory Control Leadership Development Certificates
Save

| Microsoft Careers

Microsoft

Redmond, WA 55 days ago
CUDA GPU ROCm Triton PTX CUTLASS C++ Parallel Computing Algorithm Optimization Performance Profiling Memory Hierarchies Deep Learning Model Compression Accelerator Design Machine Learning Systems Research
Save

| Microsoft Careers

Microsoft

Redmond, WA 54 days ago
inventory management systems configuration management databases asset management repositories RMA portals CI/CD Terraform AWS Kubernetes Docker Prometheus Grafana Python SQL PostgreSQL Git Jira Confluence
Save