Backend Infrastructure & Agentic AI Platforms Software Development Engineer, Senior

Booz Allen Hamilton

Quick summary

Work type
On-site
Location
McLean, VAEatontown, NJ
Salary
$86,800–$198,000 / yr
Posted
5 days ago
Closes
Sep 9, 2026
Nearby
99+ roles within 25 mi

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $203k
This role $142k
$67k most similar roles pay here $273k

This role pays less than 89% of similar roles. Most pay $167,550–$238,175 — the shaded band above. At the midpoint, this role pays about $142k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Booz Allen Hamilton

Booz Allen Hamilton is a management and technology consulting firm that provides analytics, digital, engineering, and cybersecurity solutions primarily to U.S. government agencies and commercial clients. Industry: Management & Technology Consulting

Booz Allen Hamilton currently has 702 open roles on FindRole.

Listed pay typically runs $86,800–$198,000 across 693 roles with salary data.

Most-posted roles

View all roles at Booz Allen Hamilton

At a glance

TL;DR · Backend Infrastructure & Agentic AI Platforms Software Development Engineer, Senior

Apply Now Log in to save

As a Senior Software Development Engineer on the Advanced Research Projects Agency for Health (ARPA-H) team, you will own both backend infrastructure and agentic AI systems, ensuring production reliability, security, and observability from day one. Your responsibilities include managing Azure Functions, API Management, Container Apps, and OpenAI services, while also handling data storage, retrieval pipelines, and vector databases. You’ll implement CI/CD pipelines, manage secrets, and optimize cost-per-query without compromising quality. Additionally, you will design LLM orchestration infrastructure, build RAG pipelines, and ensure robust fallback patterns for AI service dependencies. The role requires expertise in Python, Azure services, containerization, and modern backend frameworks, as well as a strong background in authentication systems, distributed systems, and security-conscious engineering.

Skills

Microsoft Azure Azure Functions API Management Container Apps OpenAI Service Python CI/CD OAuth2 OIDC Entra ID Docker Kubernetes Terraform PostgreSQL Vector Databases RAG Pipelines LLM Orchestration MCP Servers A2A Communication Patterns

What you'll do

  • Own end-to-end backend infrastructure on Microsoft Azure for ARPA-H projects.
  • Design and maintain data layer including storage, retrieval pipelines, vector databases, and document indexing.
  • Implement CI/CD pipelines, deployment automation, and manage secrets across all integrations with external providers.
  • Build LLM orchestration, routing, and multi-model switching infrastructure for OpenAI GPT, Anthropic Claude, and Google Gemini families.
  • Define and enforce system-level SLOs for availability, response time, and tool call reliability.

What we're looking for

  • 7+ years of software engineering experience in building and operating production systems
  • Experience owning and shipping complex products end-to-end in high-velocity environments
  • Proficiency with Microsoft Azure services including Functions, API Management, Container Apps, and OpenAI Service
  • Expertise in backend languages (Python), containerization, CI/CD, and infrastructure as code
  • Knowledge of modern backend frameworks, async patterns, distributed systems, APIs, data pipelines, and software design patterns
  • Ability to own production systems, including monitoring, alerting, logging, and incident response

Related searches

More Backend Infrastructure & Agentic AI Platforms Software Development Engineer jobs Backend Infrastructure & Agentic AI Platforms Software Development Engineer jobs in McLean All jobs at Booz Allen Hamilton

More like this

Similar roles

Senior Software Engineer, AI Platforms

JLL (Jones Lang LaSalle)

Boston, MA +3 13 days ago $120,000–$200,000
Python Node.js React Azure AWS GCP Docker Kubernetes CI/CD Git GitHub SQL Server CosmosDB Vector databases RAG systems Prompt engineering LLM integration Automated testing frameworks
Hybrid
Save

AI Software Engineer, Senior

Booz Allen Hamilton

Laurel, Maryland 59 days ago $86,800–$198,000
Python Java C++ JavaScript TypeScript LLM-powered developer tools CI/CD DevOps VS Code Kubernetes Docker GitHub GitLab Jenkins Agentic AI frameworks Orchestration systems Cloud services PostgreSQL MongoDB
Save

AI Software Engineer, Senior

Booz Allen Hamilton

Laurel, MD +1 59 days ago $86,800–$198,000
Python Rust Go Scala Java GitLab CI Jenkins Git Linux Docker Podman AWS LocalStack ESXi Ansible Kubernetes SIEM Security+ Linux+
Save