Software Engineer AI Infra

Microsoft

Confirmed live yesterday High trust

Hybrid

Quick summary

Work type: Hybrid
Location: —
Salary: $102,100–$202,200 / yr
Posted: 16 days ago
Freshness: Confirmed live yesterday
Closes: Feb 21, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $181k

This role $152k

$88k most similar roles pay here $233k

This role pays less than 64% of similar roles. Most pay $147,050–$214,000 — the shaded band above. At the midpoint, this role pays about $152k versus about $181k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 598 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 586 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Software Engineer AI Infra

Role Posting Log in to save

As a Software Engineer AI Infra on the Microsoft AI team, you will contribute to building state-of-the-art large language models. You will work across engineering and research to develop software systems for pre-training and post-training infrastructure, including benchmarking systems, evaluation tools, routers, and backend systems. Your daily work involves gathering data and insights to develop the pre-training compute roadmap while contributing to model architecture, data curation, training, inference infrastructures, evaluation protocols, alignment, and reinforcement learning from human feedback. The role requires proficiency in programming languages such as C, C++, C#, Java, JavaScript, or Python. Preferred qualifications include experience with generative AI, distributed computing, and leading technical projects. You will solve complex problems at the cutting edge of AI to develop models that power innovative products in a fast-paced development cycle.

Skills

LLM Generative AI Python C++ C# Java JavaScript Distributed Computing RLHF Model Architecture Data Curation Inference Infrastructure Benchmarking Systems backend systems Pre-training Post-training

What you'll do

Develop software systems for pre-training and post-training infrastructure including benchmarking, evaluation, and backend systems.
Gather data and insights to develop the pre-training compute roadmap.
Contribute to the development of AI models that power innovative products.
Design and implement model architecture, data curation, and training/inference infrastructures.
Develop evaluation protocols and work on alignment and reinforcement learning from human feedback (RLHF).
Navigate technical roadblocks to deliver features to users quickly and iteratively.
Support architectural decisions using data-driven insights.

What we're looking for

Bachelor's Degree in Computer Science or related technical field and 2+ years of engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python.
Equivalent experience to the required degree and years of experience is acceptable.
Master's Degree in Computer Science or related technical field and 3+ years of engineering experience (preferred).
Bachelor's Degree in Computer Science or related technical field and 5+ years of engineering experience (preferred).
Experience with generative AI (preferred).
Experience with distributed computing (preferred).
Experience leading technical projects and supporting architectural decisions with data (preferred).

Similar roles

Capacity & Efficiency Infrastructure

Microsoft

175 days ago $119,800–$234,700

Python C++ CUDA Triton NCCL PyTorch JAX InfiniBand NVLink Distributed Training High-Performance Computing GPU Architecture LLM GenAI Telemetry Systems Profiling Benchmarking C# Java

6+ yrs exp Hybrid

Save

Principal Software Engineer

Microsoft

Redmond, WA 10 days ago $142,800–$274,800

Python C++ C# Java JavaScript C Distributed Systems Machine Learning Generative AI Recommendation Systems AI Agents Model Training Inference Optimization Observability Backend Services

6+ yrs exp Hybrid

Save

Principal Software Engineer, AI Content Systems

Microsoft

21 days ago $165,600–$296,400

LLM Python C++ C# Java JavaScript Distributed Systems Cloud-Native Architecture Microservices Retrieval Prompt Orchestration Data Modeling System Design Observability Responsible AI

8+ yrs exp Hybrid

Save

Artificial Intelligence Software Engineer

General Dynamics

Remote (Sudbury, MA) 28 days ago $142,696–$158,303

Python LangChain LangGraph RAG LLM Docker Kubernetes CI/CD REST API Vector Databases Knowledge Graphs AWS Azure GCP Kafka Airflow Oracle Snowflake Claude Gemini Codex

8+ yrs exp Remote

Save

Artificial Intelligence Software Engineer

Booz Allen Hamilton

Aurora, CO +1 21 days ago $69,400–$158,000

LLM RAG LangChain LlamaIndex Hugging Face vLLM llama.cpp Node.js JavaScript React RESTFul APIs DevSecOps GitHub Actions CI/CD Agile Linux AWS Azure GCP MATLAB Cameo MagicDraw SparxEA DOORS IBM Rhapsody Teamwork Cloud ModelCenter TeamCenter

2+ yrs exp

Save

Software Engineer, AI

SHI International

Remote 2 days ago $125,000–$150,000

Python LLMs RAG React SQL Microsoft Azure NVIDIA CUDA API CI/CD Containers Prompt Orchestration Source Control

4+ yrs exp Remote

Save