AI Systems Design Architect, Assistant Vice President

State Street

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Quincy, MABoston, MAAustin, TXBurlington, MA
Salary
$90,000–$157,500 / yr
Posted
16 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $187k
This role $124k
$74k most similar roles pay here $241k

This role pays less than 90% of similar roles. Most pay $148,606–$224,562 — the shaded band above. At the midpoint, this role pays about $124k versus about $187k for comparable roles.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 176 open roles on FindRole.

Listed pay typically runs $120,000–$202,500 across 172 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · AI Systems Design Architect, Assistant Vice President

The AI Systems Design Architect - Assistant Vice President leads the end-to-end system design for a major Generative AI platform and shared AI services. This role involves translating business requirements into robust technical architectures, defining reference designs, and establishing integration contracts across the AI stack. The architect will build scalable solutions for model integration, orchestration, RAG, prompt workflows, and agentic AI workflows while ensuring compliance with Responsible AI and governance standards. Key responsibilities include conducting architecture reviews, evaluating proofs-of-concept, and collaborating with cross-functional teams to ensure production readiness. The role requires expertise in Generative AI, LLMs, vector databases, and microservices within cloud environments like AWS, Azure, or Google Cloud Platform. Candidates must possess skills in API architecture, distributed systems, and cloud-native services to solve complex problems regarding security, resiliency, and observability for enterprise-grade AI applications.

What you'll do

  • Own end-to-end system design for the AI platform, including model integration, orchestration, APIs, and data flows.
  • Translate business and product requirements into scalable, secure, and maintainable technical architectures.
  • Define reference architectures, design standards, integration contracts, and non-functional requirements for the AI platform.
  • Create reusable architecture patterns for RAG, model serving, prompt workflows, and agentic AI workflows.
  • Design cloud-based solutions on AWS, Azure, or GCP ensuring scalability, observability, and operational readiness.
  • Ensure all designs comply with Responsible AI, model governance, data handling, and risk management requirements.
  • Conduct architecture assessments, technical design reviews, and proof-of-concept evaluations for new AI use cases.
  • Provide guidance on architectural decisions and trade-offs while ensuring adherence to enterprise standards across pods.

What we're looking for

  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related discipline.
  • Master's degree (preferred).
  • 8–14 years of experience in solution, enterprise application, platform, or AI/ML architecture.
  • Hands-on experience with Generative AI, LLMs, RAG architectures, vector databases, and AI application integration.
  • Proven experience in cloud architecture and solution design on AWS, Azure, or Google Cloud Platform.
  • Expertise in API architecture, microservices, distributed systems, and event-driven architecture.
  • Working knowledge of AI governance, Responsible AI, model risk, compliance, and operational controls.
  • Ability to communicate complex technical concepts to both technical and business stakeholders.

More like this

Similar roles

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +3 49 days ago $90,000$157,500
Generative AI LLMs RAG Machine Learning AWS Azure Google Cloud Platform Vector Databases Microservices API Architecture Distributed Systems Event-Driven Architecture DevSecOps System Integration Enterprise Architecture Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Vice President

State Street

Quincy, MA 50 days ago $120,000$217,500
Generative AI LLMs RAG Vector Databases AWS Azure Google Cloud Platform Microservices Distributed Systems API Architecture DevSecOps CI/CD Platform Engineering Prompt Orchestration Cloud-Native Architecture Observability Monitoring
10+ yrs exp

AI Systems Design Architect, Vice President

State Street

Quincy, MA 7 days ago $120,000$217,500
Generative AI LLMs RAG Vector Databases AWS Azure Google Cloud Platform Microservices Distributed Systems API Architecture DevSecOps CI/CD Platform Engineering
10+ yrs exp

Senior Solution Architect, AI & Cloud Systems, Vice President

State Street

Quincy, MA +1 15 days ago $120,000$202,500
Generative AI Agentic AI AWS Databricks Python Kubernetes RAG LLMs Vector Databases Microservices APIs Event-Driven Architecture Kafka Apache Airflow Terraform OpenShift CI/CD DevSecOps LangChain LangGraph
10+ yrs exp

AI Platform and Ops Lead, Assistant Vice President

State Street

Boston, MA +4 21 days ago $90,000$157,500
Generative AI Machine Learning Azure AWS Databricks Kubernetes Terraform Python PowerShell CI/CD MLOps infrastructure-as-code LLM Services Identity and Access Management Site Reliability Engineering Disaster Recovery Observability
4+ yrs exp

Principal AI Architect

LPL Financial

Fort Mill, NC +3 28 days ago $155,942$259,869
Generative AI Agentic AI RAG LLMOps MLOps Python AWS Kubernetes EKS Bedrock DynamoDB Vector Databases Infrastructure-as-Code Microservices API Gateway DevSecOps
10+ yrs exp