AI Systems Design Architect, Vice President

State Street

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Quincy, MA
Salary
$120,000–$217,500 / yr
Employment
Full-time
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $212k
This role $169k
$103k $274k
below market most similar roles pay here above market

This role pays less than 73% of similar roles. Most pay $165,766–$257,718 — the blue band above. At the midpoint, this role pays about $169k versus about $212k for comparable roles.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 352 open roles on FindRole.

Listed pay typically runs $110,000–$188,750 across 168 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · AI Systems Design Architect, Vice President

The AI Systems Design Architect, Vice President leads the enterprise AI system architecture strategy across the full Generative AI platform stack. This role involves defining architecture direction, technology standards, and cloud design principles for AI platforms and shared services. The architect will own the strategy for orchestration layers, model integration, APIs, and data flows while establishing reusable patterns for RAG, model serving, prompt orchestration, and agentic AI workflows. Key responsibilities include chairing governance forums, performing technical due diligence, and ensuring compliance with Responsible AI and model risk standards. The position requires expertise in AWS, Azure, or Google Cloud Platform, along with deep knowledge of LLMs, vector databases, microservices, distributed systems, DevSecOps, and CI/CD to build secure, resilient, and scalable enterprise AI solutions.

What you'll do

  • Drive enterprise-wide AI system architecture strategy across the full Generative AI platform stack.
  • Define and govern reference architectures, design standards, and cloud design principles for AI platforms.
  • Establish reusable enterprise patterns for RAG, model serving, prompt orchestration, and agentic AI workflows.
  • Lead architecture decisions for scalable, secure, and compliant cloud and hybrid AI environments.
  • Chair architecture governance forums to review solution designs and resolve technical trade-offs.
  • Ensure AI solutions comply with Responsible AI, data controls, model risk, and regulatory requirements.
  • Conduct architecture assessments, technical due diligence, and build-vs-buy evaluations for AI platforms.
  • Mentor architects and engineering leaders to improve design quality and adoption of enterprise standards.

What we're looking for

  • Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline.
  • Master’s degree (preferred).
  • 12–17 years of experience in solution, enterprise application, platform, or AI/ML architecture, including leadership of large-scale enterprise initiatives.
  • Deep hands-on and architectural experience with Generative AI, LLMs, ML systems, RAG, vector databases, and prompt orchestration.
  • Proven expertise in cloud architecture and enterprise solution design on AWS, Azure, or Google Cloud Platform (GCP).
  • Expertise in API architecture, microservices, distributed systems, event-driven patterns, and platform design.
  • Strong understanding of AI governance, Responsible AI, model risk, compliance, and DevSecOps concepts.
  • Demonstrated ability to lead architecture discussions with senior executives and communicate with technical and non-technical stakeholders.

More like this

Similar roles

AI Systems Design Architect, Vice President

State Street

Quincy, MA 105 days ago
Generative AI LLMs RAG AWS Azure Google Cloud Platform Vector Databases Distributed Systems Microservices API Architecture CI/CD DevSecOps Platform Engineering Model Serving Prompt Orchestration Agentic AI IAM Observability
10+ yrs exp

AI System Design Architect, Vice President

State Street

Quincy, MA +3 30 days ago $120,000–$217,500
Generative AI LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems API Architecture CI/CD DevSecOps Platform Engineering Model Serving Prompt Orchestration Agentic AI IAM Observability
10+ yrs exp Hybrid

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +3 104 days ago
Generative AI Machine Learning LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems Event-Driven Architecture API Architecture DevSecOps Model Governance System Integration Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +4 71 days ago $90,000–$157,500
Generative AI Machine Learning LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems Event-Driven Architecture API Architecture DevSecOps Model Governance System Integration Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA 51 days ago
Generative AI Machine Learning LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems Event-Driven Architecture API Architecture DevSecOps Model Serving System Integration Cloud-Native Services Responsible AI Model Governance
8+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA 16 days ago $90,000–$157,500
Generative AI Machine Learning LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems Event-Driven Architecture API Architecture DevSecOps Model Governance Responsible AI System Design Cloud-Native Services
8+ yrs exp