AI Systems Design Architect, Assistant Vice President

State Street

Confirmed live yesterday Low trust

Quick summary

Work type: On-site
Location: Quincy, MABoston, MAPrinceton, NJAustin, TX
Employment: Full-time
Posted: 95 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $182k

$127k $232k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $142,300–$221,425.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 351 open roles on FindRole.

Listed pay typically runs $115,000–$195,944 across 199 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · AI Systems Design Architect, Assistant Vice President

Role Posting Log in to save

The AI Systems Design Architect - Assistant Vice President will join the team to own end-to-end system design for a major Generative AI platform and shared AI services. This role involves translating business requirements into robust technical architectures, defining integration contracts, and establishing non-functional requirements across the AI stack. You will build scalable, secure, and resilient solutions for model integration, orchestration, and data flows. Key responsibilities include designing reference architectures for RAG, model serving, and agentic AI workflows while ensuring alignment with Responsible AI and model governance. You must utilize expertise in LLMs, vector databases, and cloud architecture on AWS, Azure, or Google Cloud Platform. The role requires deep knowledge of microservices, distributed systems, and API architecture to solve complex production-grade AI integration problems.

Skills

Generative AI Machine Learning LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems Event-Driven Architecture API Architecture DevSecOps Model Governance System Integration Cloud-Native Services

What you'll do

Own end-to-end system design for a major GenAI platform, including model integration, orchestration, and data flows.
Translate business and product requirements into scalable, secure, and maintainable AI solution designs.
Define reference architectures, design standards, integration contracts, and non-functional requirements for the platform.
Establish reusable architecture patterns for RAG, model serving, prompt workflows, and agentic AI workflows.
Design cloud-native solutions on AWS, Azure, or GCP ensuring interoperability, scalability, and observability.
Ensure all designs align with Responsible AI, model governance, data handling, and compliance requirements.
Conduct architecture assessments, technical design reviews, and proof-of-concept evaluations for new AI use cases.
Review solution designs across pods to provide guidance on architecture decisions and trade-offs.

What we're looking for

Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline.
Master’s degree (preferred).
8–14 years of experience in solution, enterprise application, platform, or AI/ML architecture.
Hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI application integration.
Proven experience in cloud architecture and solution design on AWS, Azure, or Google Cloud Platform.
Expertise in API architecture, microservices, distributed systems, event-driven architecture, and system integration patterns.
Working knowledge of AI governance, Responsible AI, model risk, compliance, testing, and operational controls.
Ability to lead architecture discussions and communicate complex technical concepts to technical and business stakeholders.

Similar roles

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +4 62 days ago $90,000–$157,500

8+ yrs exp

Save

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA 41 days ago $90,000–$157,500

Generative AI Machine Learning LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems Event-Driven Architecture API Architecture DevSecOps Model Serving System Integration Cloud-Native Services Responsible AI Model Governance

8+ yrs exp

Save

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA 6 days ago $90,000–$157,500

8+ yrs exp

Save

AI Systems Design Architect, Vice President

State Street

Quincy, MA 96 days ago

Generative AI LLMs RAG AWS Azure Google Cloud Platform Vector Databases Distributed Systems Microservices API Architecture CI/CD DevSecOps Platform Engineering Model Serving Prompt Orchestration Agentic AI IAM Observability

10+ yrs exp

Save

AI System Design Architect, Vice President

State Street

Quincy, MA +3 20 days ago $120,000–$217,500

Generative AI LLMs RAG AWS Azure Google Cloud Platform Vector Databases Microservices Distributed Systems API Architecture CI/CD DevSecOps Platform Engineering Model Serving Prompt Orchestration Agentic AI IAM Observability

10+ yrs exp Hybrid

Save

Senior Solution Architect, AI & Cloud Systems, Vice President

State Street

Quincy, MA +1 61 days ago $120,000–$202,500

Generative AI Agentic AI AWS Databricks Python Kubernetes RAG LLMs Microservices APIs Event-driven Architecture CI/CD Terraform Kafka Apache Airflow LangChain LangGraph Pydantic PostgreSQL S3 EC2 Lambda API Gateway IAM DevSecOps Infrastructure as Code Data Lakes Lakehouse Architecture

10+ yrs exp

Save