Application Architect - AI Integration joins the IBM Consulting team to design and govern end-to-end architectures that embed AI capabilities into enterprise applications and workflows. The role involves collaborating with stakeholders to translate business objectives into scalable, policy-compliant designs while managing prompt governance, guardrails, and lifecycle management. You will build reference patterns for AI services, models, and orchestration layers integrated with existing systems and data platforms. Key technologies include AWS cloud architecture (EKS, RDS, Lambda), microservices, event-driven systems like Kafka or SQS, and AI/ML tools such as Bedrock and SageMaker. You will utilize frameworks like LangChain and LlamaIndex to develop RAG pipelines and agentic workflows. The role addresses complex integration challenges within regulated industries, specifically focusing on financial services or insurance domains requiring compliance with standards like FINRA, SOC 2, and GLBA.
Design end-to-end architectures that embed AI capabilities into enterprise applications and workflows.
Define reference patterns for AI services, models, and orchestration layers to integrate with existing systems.
Translate business objectives into scalable, resilient, and policy-compliant technical designs.
Establish governance for prompts, guardrails, and lifecycle management to ensure responsible AI principles.
Manage the integration of LLM orchestration and RAG pipelines into production environments.
Evaluate and select AI services based on data privacy, compliance, and total cost of ownership.
Drive architecture decisions through clear documentation and consensus-building across engineering and business teams.
Mentor senior engineers and establish architectural standards for team adoption.
What we're looking for
Bachelor's Degree required.
12+ years of enterprise application architecture experience is required.
At least 3 years of experience in a lead or principal architect role owning cross-domain target-state design is required.
Proven experience with microservices, event-driven architectures (Kafka/SQS/EventBridge), and API-first designs at scale is required.
AWS cloud architecture expertise including EKS, RDS/Aurora, API Gateway, Lambda, SQS/SNS, MSK, and AI/ML services like Bedrock and SageMaker is required.
Experience designing RAG pipelines, LLM orchestration (LangChain, LlamaIndex), and agentic workflow patterns for production systems is required.
Experience designing systems under regulatory frameworks such as FINRA, FSRA, SOC 2, GLBA, or CCPA is required.
Demonstrated ability to lead architecture decisions, mentor engineers, and work in Agile/scaled delivery environments is required.