Senior AI Architect – Azure & Cloud AI

IBM

Quick summary

Work type
On-site
Location
New York, NY
Posted
6 days ago

Market check

Salary context

How this pay compares to similar roles

Similar $208k
$159k most similar roles pay here $272k

This listing doesn't post a salary. Most similar roles pay $170,300–$246,150.

Based on 240 similar postings.

Employer

About IBM

IBM is a US-based global technology company providing hybrid cloud, AI, consulting, enterprise software, and IT infrastructure products and services.

IBM currently has 743 open roles on FindRole.

Listed pay typically runs $1,000,000–$1,000,000 across 8 roles with salary data.

Most-posted roles

View all roles at IBM

At a glance

TL;DR · Senior AI Architect – Azure & Cloud AI

Apply Now Log in to save

As a Senior AI Architect at our firm, you will join a dynamic team focused on delivering high-impact AI solutions to enterprise clients. Your role involves providing technical leadership and defining the architectural vision for complex multi-workstream AI programs using Azure technologies such as OpenAI, Machine Learning, and data platforms. You will develop reference architectures, mentor team members, and ensure that all AI solutions are scalable, secure, and aligned with business objectives. Key responsibilities include leading architecture design sessions, translating business requirements into technical solutions, and establishing standards for model deployment, orchestration, and governance. Preferred skills encompass experience with Azure data services, agentic AI frameworks like LangChain, and a deep understanding of responsible AI practices and enterprise security considerations. This role demands expertise in building and operationalizing large-scale AI systems that integrate seamlessly with existing enterprise infrastructure.

Skills

Azure Azure OpenAI Azure Machine Learning LangChain CI/CD Model Context Protocols MCPs Azure Synapse Azure Data Factory Python PostgreSQL Kubernetes Docker Terraform Prometheus Grafana GitLab GitHub

What you'll do

  • Define and govern end-to-end Azure AI architecture for complex projects.
  • Develop reference architectures and reusable assets to accelerate AI delivery.
  • Translate business requirements into scalable, secure AI solutions on Azure.
  • Lead design sessions with stakeholders to align on technical approach and strategy.
  • Establish standards for model deployment, data integration, and AI observability.

What we're looking for

  • 8+ years leading implementation of enterprise-grade AI solutions in cloud and hybrid environments.
  • Design scalable AI platforms using Azure services for secure model deployment and governance.
  • Build and operationalize LLM-powered applications with frameworks like LangChain and LangGraph.
  • Define agentic architectures including multi-agent orchestration, memory management, and MCP integration patterns.
  • Establish best practices for AI industrialization, including CI/CD, observability, and prompt/version management.
  • Integrate AI systems with enterprise applications, APIs, vector databases, and operational systems.

Related searches

More Senior AI Architect jobs Senior AI Architect jobs in New York All jobs at IBM

More like this

Similar roles

Senior AI Architect – Azure & Cloud AI

IBM

Chicago, IL 6 days ago
Azure Azure OpenAI Azure Machine Learning CI/CD LangChain LangGraph Azure Synapse Azure Data Factory Microsoft Fabric Prometheus Grafana PostgreSQL Python Go Docker MCPs Kubernetes Terraform AWS
Save

Senior AI Architect – Azure & Cloud AI

IBM

Dallas, TX 6 days ago
Azure Azure OpenAI Azure Machine Learning LangChain CI/CD Azure Synapse Azure Data Factory Python PostgreSQL Kubernetes MCPs LangGraph AutoGen Semantic Kernel Azure AI Engineer Associate Azure Solutions Architect Expert
Save

Senior Cloud Solution Architect - Cloud & AI Data Platform

Microsoft

US 59 days ago
Microsoft Azure Azure Databricks Cosmos DB Purview CI/CD Python SQL Power BI Kubernetes Terraform Git GitHub DevOps AI Machine Learning Data Analytics MVP Proof of Concept Change Management Security Compliance Cloud Architecture Virtual Teams Technical Presentations Community Events
Save

Senior Artificial Intelligence (AI) Solutions Architect

Boeing

Remote (Seattle, WA) 5 days ago $184,450–$249,550
AI ML Cloud Architecture Data Architecture MLOps Generative AI Agentic AI Deep Learning Semantic Layers Ontologies Knowledge Graphs Vector Databases Event-Driven Architecture API Integration Scalable Cloud-Native Design CI/CD Python Java Kubernetes AWS Azure GCP PostgreSQL Docker Prometheus Grafana
Remote
Save

Senior AI Performance Architect

Qualcomm

Raleigh, NC 139 days ago $126,700–$217,900
Python C++ TensorFlow PyTorch DeepSpeed FSDP NVIDIA DGX Network-on-Chip System-on-Chip Memory Technologies Communication Protocols Hardware Modeling Performance Estimation Power Estimation GPU Architectures LLM Architectures
Save