Vice President, AI System Design Architect

State Street

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Quincy, MABoston, MAPrinceton, NJAustin, TX
Salary
$120,000–$217,500 / yr
Employment
Full-time
Posted
1 day ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $206k
This role $169k
$104k most similar roles pay here $265k

This role pays less than 71% of similar roles. Most pay $162,000–$249,550 — the shaded band above. At the midpoint, this role pays about $169k versus about $206k for comparable roles.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 308 open roles on FindRole.

Listed pay typically runs $120,000–$202,500 across 214 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · Vice President, AI System Design Architect

The AI System Design Architect, Vice President leads the enterprise AI system architecture strategy across the full Generative AI platform stack. This role involves defining architecture direction, technology standards, and cloud design principles for AI platforms and shared services. The architect will own the strategy for orchestration layers, model integration, APIs, and data flows while establishing reusable patterns for RAG, model serving, prompt orchestration, and agentic AI workflows. Key responsibilities include leading architecture governance, ensuring compliance with Responsible AI standards, and managing technical trade-offs for scalable, secure, and resilient systems. The position requires expertise in Generative AI, LLMs, vector databases, and distributed systems using AWS, Azure, or Google Cloud Platform. The work focuses on platform modernization, production onboarding, and building secure, high-performing enterprise AI solutions.

What you'll do

  • Drive enterprise-wide AI system architecture strategy across the full Generative AI platform stack.
  • Define and govern reference architectures, design standards, and cloud design principles for AI platforms.
  • Establish reusable enterprise patterns for RAG, model serving, prompt orchestration, and agentic AI workflows.
  • Lead architecture decisions for scalable, secure, and compliant cloud and hybrid AI environments.
  • Chair architecture governance forums to review solution designs and resolve technical trade-offs.
  • Ensure AI solutions comply with Responsible AI, data controls, model risk, and regulatory requirements.
  • Conduct architecture assessments, technical due diligence, and platform modernization for AI systems.
  • Guide enterprise decisions on platform capabilities, shared services, and build-vs-buy evaluations.

What we're looking for

  • Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline.
  • Master’s degree (preferred).
  • 12–17 years of experience in solution, enterprise application, platform, or AI/ML architecture, including leading large-scale enterprise initiatives.
  • Deep hands-on and architectural experience with Generative AI, LLMs, ML systems, RAG, vector databases, and prompt orchestration.
  • Proven expertise in cloud architecture and enterprise solution design on AWS, Azure, or Google Cloud Platform (GCP).
  • Expertise in API architecture, microservices, distributed systems, event-driven patterns, and platform design.
  • Strong understanding of AI governance, Responsible AI, model risk, compliance, and DevSecOps concepts.
  • Demonstrated ability to lead architecture discussions with senior executives and communicate with technical and non-technical stakeholders.

More like this

Similar roles

AI Systems Design Architect, Vice President

State Street

Quincy, MA 77 days ago $120,000–$217,500
Generative AI LLMs RAG Vector Databases AWS Azure Google Cloud Platform Microservices Distributed Systems API Architecture DevSecOps CI/CD Platform Engineering Prompt Orchestration Cloud-Native Architecture Observability Monitoring
10+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA 22 days ago $90,000–$157,500
Generative AI LLMs Machine Learning RAG Vector Databases AWS Azure Google Cloud Platform Microservices API Architecture Distributed Systems Event-Driven Architecture DevSecOps System Integration Enterprise Architecture Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +3 76 days ago $90,000–$157,500
Generative AI LLMs RAG Machine Learning AWS Azure Google Cloud Platform Vector Databases Microservices API Architecture Distributed Systems Event-Driven Architecture DevSecOps System Integration Enterprise Architecture Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +4 43 days ago $90,000–$157,500
Generative AI LLMs RAG Machine Learning AWS Azure Google Cloud Platform Vector Databases Microservices API Architecture Distributed Systems Event-Driven Architecture DevSecOps System Integration Enterprise Architecture Cloud-Native Services
8+ yrs exp

Vice President AI Engineer, Corporate Functions Technology

State Street

Boston, MA +1 37 days ago $120,000–$217,500
Generative AI LLMs RAG LangChain MLOps LLMOps AWS Azure Microservices APIs Vector Databases Semantic Search Data Engineering Distributed Systems Prompt Engineering Machine Learning
10+ yrs exp

Senior Solution Architect, AI & Cloud Systems, Vice President

State Street

Quincy, MA +1 42 days ago $120,000–$202,500
Generative AI Agentic AI AWS Databricks Python Kubernetes RAG LLMs Vector Databases Microservices APIs Event-Driven Architecture Kafka Apache Airflow Terraform OpenShift CI/CD DevSecOps LangChain LangGraph
10+ yrs exp