Senior Agentic AI and LLM Applications Software Development Engineer

Booz Allen Hamilton

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Washington, DC
Salary
$86,800–$198,000 / yr
Posted
14 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $211k
This role $142k
$66k most similar roles pay here $281k

This role pays less than 94% of similar roles. Most pay $175,625–$246,150 — the shaded band above. At the midpoint, this role pays about $142k versus about $211k for comparable roles.

Based on 240 similar postings.

Employer

About Booz Allen Hamilton

Booz Allen Hamilton is a management and technology consulting firm that provides analytics, digital, engineering, and cybersecurity solutions primarily to U.S. government agencies and commercial clients. Industry: Management & Technology Consulting

Booz Allen Hamilton currently has 802 open roles on FindRole.

Listed pay typically runs $86,800–$198,000 across 783 roles with salary data.

Most-posted roles

View all roles at Booz Allen Hamilton

At a glance

TL;DR · Senior Agentic AI and LLM Applications Software Development Engineer

Agentic AI and LLM Applications Software Development Engineer, Senior joins the GRACE team to build an ecosystem of autonomous, multi-agent systems designed to accelerate research and decision-making. This role focuses on the application layer, where you will design and build agentic workflows involving multi-step reasoning, memory, tool-calling, and RAG features like citation grounding and hallucination mitigation. You will manage LLM orchestration across OpenAI GPT, Anthropic Claude, and Google Gemini while optimizing for token economics and context management. Key responsibilities include developing A2A communication patterns, building evaluation pipelines for quality and safety, and implementing MCP client-side integrations. The ideal candidate possesses over seven years of experience in Python and other backend languages, with expertise in cloud platforms like AWS or GCP, containerization, CI/CD pipelines, and distributed systems to solve complex problems in the production AI space.

What you'll do

  • Design and build multi-step reasoning, planning, memory, and tool-use workflows for single and multi-agent systems.
  • Implement agent-to-agent communication patterns to enable autonomous collaboration and task handoffs.
  • Build and maintain the tool-calling layer including schemas, error handling, and result formatting.
  • Manage LLM orchestration tasks such as prompt construction, context management, and model selection logic.
  • Develop RAG features including query formulation, ranking, citation grounding, and hallucination mitigation.
  • Create evaluation pipelines for LLM quality involving regression testing, safety checks, and A/B experimentation.
  • Optimize token economics by designing cost-efficient prompts and managing context window budgets.
  • Translate ambiguous product requirements into technical designs and ship end-to-end features from backend to API.

What we're looking for

  • Bachelor's degree in Computer Science or Software Engineering.
  • 7+ years of experience with software engineering and building/operating production systems.
  • Proficiency in Python and at least one other backend language.
  • Experience building and operating systems on major cloud platforms like AWS, GCP, or Azure.
  • Experience with containerization and working within CI/CD pipelines.
  • Knowledge of modern backend frameworks, async patterns, distributed systems, APIs, and data pipelines.
  • Experience building production systems using LLMs, including RAG, tool-calling, and multi-agent orchestration.
  • Ability to communicate clearly, work with empathy, and function as a self-starter in high-velocity environments.

More like this

Similar roles

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 49 days ago $229,900$262,400
LLM Python PyTorch Huggingface AWS VectorDBs Nemo Guardrails Go Scala Java C++ C# Machine Learning LLM Inference Similarity Search Model Evaluation Observability
6+ yrs exp

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 21 days ago $229,900$262,400
LLM Python PyTorch Huggingface AWS VectorDBs Nemo Guardrails Go Scala Java C++ C# Machine Learning LLM Inference Similarity Search Model Evaluation Observability
6+ yrs exp

Senior Agentic AI/ML Engineer

General Dynamics

Arlington, VA 73 days ago $199,750$270,250
Python Machine Learning LLM RAG Agentic AI CI/CD Docker Kubernetes Git PyTorch TensorFlow scikit-learn LangChain LangGraph PostgreSQL RESTful APIs MLOps LLMOps
10+ yrs exp

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 16 days ago $229,900$262,400
LLM Python PyTorch Huggingface AWS VectorDBs Nemo Guardrails Go Scala Java C++ C# Machine Learning Reinforcement Learning Similarity Search Model Evaluation
6+ yrs exp