RAG Application Engineer

Booz Allen Hamilton

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Annapolis Junction, MDFort Meade, MD
Salary
$69,400–$158,000 / yr
Employment
Full-time
Posted
7 days ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $170k
This role $114k
$53k $219k
below market most similar roles pay here above market

This role pays less than 92% of similar roles. Most pay $137,000–$202,800 — the blue band above. At the midpoint, this role pays about $114k versus about $170k for comparable roles.

Based on 240 similar postings.

Employer

About Booz Allen Hamilton

Booz Allen Hamilton is a management and technology consulting firm that provides analytics, digital, engineering, and cybersecurity solutions primarily to U.S. government agencies and commercial clients. Industry: Management & Technology Consulting

Booz Allen Hamilton currently has 1662 open roles on FindRole.

Listed pay typically runs $86,800–$198,000 across 904 roles with salary data.

Most-posted roles

View all roles at Booz Allen Hamilton

At a glance

TL;DR · RAG Application Engineer

JOB TITLE: RAG Application Engineer As a RAG Application Engineer, you will join a team to build the application layer for Retrieval-Augmented Generation systems. You will implement end-to-end query workflows, including embedding generation, hybrid retrieval, reranking, citation assembly, and request-level guardrails to provide grounded responses. Your daily responsibilities include developing API endpoints, managing model integrations, enforcing authentication and authorization controls, and implementing retry, timeout, and error-handling strategies. You will use Python or Java to build back-end services, containerize applications using Docker, and deploy to ECS, EKS, or Kubernetes. The role requires expertise in vector search, OpenSearch, and telemetry tools like structured logs and metrics. You will solve technical problems regarding RAG runtime logic, ensuring stable and secure performance within a cloud-based environment for mission use.

What you'll do

  • Implement end-to-end query workflows including embedding generation, hybrid retrieval, reranking, and citation assembly.
  • Develop and maintain API endpoints and orchestration logic for AI model and search calls.
  • Enforce authentication, authorization controls, and request-level guardrails within the application layer.
  • Implement robust retry, timeout, and error-handling strategies to ensure service resilience.
  • Containerize services using Docker and deploy them to ECS, EKS, or Kubernetes environments.
  • Build and maintain telemetry systems including structured logs, metrics, and traces for observability.
  • Design and manage model integrations and service routing in secure, cloud-based environments.

What we're looking for

  • Experience building back-end or platform services using Python or Java.
  • Experience designing or integrating RAG workflows, including embeddings, hybrid retrieval, vector search, and reranking.
  • Experience implementing API request pipelines, orchestration logic, and service routing for AI model and search calls.
  • Experience enforcing authentication and authorization within service logic.
  • Experience developing resilient services with retry, backoff, timeout, and error-handling strategies.
  • Experience containerizing applications using Docker and deploying to ECS, EKS, or Kubernetes.
  • Experience building telemetry, including structured logs, metrics, and traces.
  • TS/SCI clearance and a high school diploma or GED are required.

More like this

Similar roles

RAG Data Engineer

Booz Allen Hamilton

Annapolis Junction, MD +1 7 days ago $61,900–$141,000
RAG Python OpenSearch Amazon Bedrock AWS Docker Kubernetes Terraform CloudFormation AWS CDK Spark Ray Dask Kafka Amazon SQS ETL Elasticsearch Vector Similarity Search BM25

Application Engineer

Applied Materials

Santa Clara, CA 141 days ago
AI ML Python R C# Generative AI Deep Learning Data Analytics Algorithm Development Production Software System Integration Optimization Large-scale Data Systems
5+ yrs exp

Application Engineer

Applied Materials

Santa Clara, CA 82 days ago $124,000–$171,000
Epi FEP Technical Requirements Analysis Product Application Support SOW Technical Review

Application Engineer

Applied Materials

Benicia, CA 39 days ago $108,000–$148,500
Semiconductor Failure Analysis Fault Localization ATE DFT Silicon Debug Product Engineering Device Characterization CAD-based Debug Tools LADA LVP SDL XADA Electrical Engineering Materials Science Physics
2+ yrs exp

Application Engineer

Applied Materials

Santa Clara, CA 11 days ago $147,000–$202,500
SEM FIB ICP-MS X-ray CT SEM/EDX Materials Characterization Failure Analysis Image Analysis Metrology Surface Analysis Optical Microscopy Statistical Data Analysis Programming Scripting Data Automation

Applications Engineer

Broadcom

San Jose, CA 48 days ago
Ethernet RDMA RoCEv2 SAI SONiC Linux Kernel VxLAN SRv6 L2/L3 Switching PFC ECN DCQCN IP Tunneling Multicast Embedded Software SDK Integration QoS Load Balancing Congestion Control
10+ yrs exp