Agentic AI and LLM Applications Software Development Engineer, Senior

Booz Allen Hamilton

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Washington, DC
Employment
Full-time
Posted
60 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $206k
$141k $257k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $165,412–$246,150.

Based on 240 similar postings.

Employer

About Booz Allen Hamilton

Booz Allen Hamilton is a management and technology consulting firm that provides analytics, digital, engineering, and cybersecurity solutions primarily to U.S. government agencies and commercial clients. Industry: Management & Technology Consulting

Booz Allen Hamilton currently has 1662 open roles on FindRole.

Listed pay typically runs $86,800–$198,000 across 904 roles with salary data.

Most-posted roles

View all roles at Booz Allen Hamilton

At a glance

TL;DR · Agentic AI and LLM Applications Software Development Engineer, Senior

The Agentic AI and LLM Applications Software Development Engineer, Senior joins the GRACE team to build a production AI assistant and an ecosystem of autonomous, multi-agent systems. This senior role focuses on the application layer, where you will design and build agentic workflows, LLM integrations, tool-calling systems, and AI-powered features. Key responsibilities include implementing A2A communication patterns, managing context window budgets, building RAG features, and developing evaluation pipelines for LLM quality. You will work with OpenAI GPT, Anthropic Claude, and Google Gemini models while utilizing Python and other backend languages. The role requires expertise in cloud platforms like AWS, GCP, or Azure, as well as containerization and CI/CD pipelines. You will solve complex problems regarding multi-step reasoning, memory, and reliable orchestration in a production environment.

What you'll do

  • Design and build core agentic workflows including multi-step reasoning, planning, memory, and tool-use.
  • Implement A2A communication patterns to enable multi-agent collaboration and task hand-offs.
  • Build and maintain the tool-calling layer, including schemas, error handling, and retry logic.
  • Own LLM orchestration tasks such as prompt construction, context management, and model selection.
  • Develop RAG features focusing on query formulation, result ranking, and hallucination mitigation.
  • Build evaluation pipelines for LLM quality, including grounding assessments and regression testing.
  • Instrument agentic workflows with tracing, logging, and metrics to ensure production observability.
  • Create fallback and guardrail logic to handle unsafe or structurally incorrect AI model outputs.

What we're looking for

  • Bachelor's degree in Computer Science or Software Engineering.
  • 7+ years of experience with software engineering, including building and operating production systems.
  • Experience in high-velocity environments where you owned and shipped complex products end-to-end.
  • Experience in Python and at least one other backend language.
  • Experience building and operating systems on major cloud platforms, including AWS, GCP, or Azure.
  • Experience with containerization and working within CI/CD pipelines.
  • Knowledge of modern backend frameworks, async patterns, distributed systems, APIs, data pipelines, and software design patterns.
  • Experience building production systems on top of LLMs, including tool-calling, RAG, multi-step reasoning, and context management (preferred).

More like this

Similar roles

Agentic Systems Full-Stack Software Engineer, Senior

Booz Allen Hamilton

Fayetteville, NC 42 days ago $86,800–$198,000
Python FastAPI React TypeScript Kubernetes Terraform AWS vLLM Docker Helm Git CI/CD Vector Databases OpenTelemetry Flask Django Vue Svelte OPA Rego Cedar Casbin
2+ yrs exp

Senior AI/AML Engineer, Vice President

Citi

Irving, TX 4 days ago $138,720–$208,080
Python GenAI LLM LangChain ADK RAG Agentic Systems REST APIs Microservices GCP AWS Azure Vertex AI OpenAI Gemini Distributed Systems WebSockets Observability
6+ yrs exp Hybrid

Agentic AI, Senior Software Development Engineer

Zillow

Remote 46 days ago
Agentic AI LLMs ML Evals Observability LangChain LangGraph Databricks MLflow LangSmith Braintrust Promptfoo MCP Backend Engineering Scalable Systems Cost Management
4+ yrs exp Remote

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 95 days ago
Python Go Scala Java C++ C# PyTorch AWS Huggingface VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning Google Cloud Azure
6+ yrs exp

Senior Lead AI Engineer

Capital One Financial

New York, NY +4 67 days ago
Python Go Scala Java C++ C# PyTorch Huggingface AWS Google Cloud Azure VectorDBs Nemo Guardrails LLM Inference Similarity Search Machine Learning Model Evaluation Observability
6+ yrs exp

Senior Software Engineer, Agentic AI

Nvidia

Remote (Santa Clara, CA) +2 25 days ago $184,000–$287,500
Python Rust Go Node.js LLM RAG Vector Databases PyO3 Tokio serde OpenTelemetry Asynchronous Programming API Design Serialization Middleware
Remote