AI Systems Design Architect, Assistant Vice President

State Street

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Quincy, MA
Salary
$90,000–$157,500 / yr
Posted
4 days ago
Freshness
Confirmed live today

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $190k
This role $124k
$73k most similar roles pay here $253k

This role pays less than 87% of similar roles. Most pay $145,050–$235,487 — the shaded band above. At the midpoint, this role pays about $124k versus about $190k for comparable roles.

Based on 240 similar postings.

Employer

About State Street

State Street Corporation is one of the world''s largest custodian banks and asset managers, providing investment servicing, investment management, and investment research to institutional investors. Industry: Financial Services & Asset Custody

State Street currently has 185 open roles on FindRole.

Listed pay typically runs $120,000–$202,500 across 180 roles with salary data.

Most-posted roles

View all roles at State Street

At a glance

TL;DR · AI Systems Design Architect, Assistant Vice President

The AI Systems Design Architect - Assistant Vice President leads the end-to-end system design for a major Generative AI platform and shared AI services. This role involves translating business requirements into robust technical architectures, defining integration contracts, and establishing non-functional requirements across the AI stack. The architect will build reference architectures for RAG, model serving, prompt workflows, and agentic AI workflows while ensuring solutions are secure, resilient, and compliant with enterprise standards. Key responsibilities include conducting architecture reviews, evaluating proofs of concept, and collaborating with cross-functional teams to ensure production readiness. Technical expertise required includes Generative AI, LLMs, vector databases, and cloud platforms such as AWS, Azure, or Google Cloud. The role focuses on solving complex problems in model governance, risk management, and scalable infrastructure for large-scale enterprise AI applications.

What you'll do

  • Own end-to-end system design for the GenAI platform, including model integration, orchestration, APIs, and data flows.
  • Translate business and product requirements into scalable, secure, and maintainable technical architectures.
  • Define reference architectures, design standards, integration contracts, and non-functional requirements for the AI platform.
  • Create reusable architecture patterns for RAG, model serving, prompt workflows, and agentic AI workflows.
  • Design cloud-based solutions on AWS, Azure, or GCP ensuring scalability, observability, and operational readiness.
  • Ensure all designs comply with Responsible AI, model governance, data handling, and risk management requirements.
  • Conduct architecture assessments, technical design reviews, and proof-of-concept evaluations for new AI use cases.
  • Provide guidance on architectural decisions and trade-offs while ensuring adherence to enterprise standards across pods.

What we're looking for

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field is required; Master's degree preferred.
  • 8–14 years of experience in solution, enterprise application, platform, or AI/ML architecture.
  • Hands-on experience with Generative AI, LLMs, RAG architectures, vector databases, and AI application integration.
  • Proven experience in cloud architecture and solution design on AWS, Azure, or Google Cloud Platform.
  • Expertise in API architecture, microservices, distributed systems, and event-driven architecture.
  • Knowledge of cloud-native services including compute, storage, networking, IAM, security, and AI/ML services.
  • Working knowledge of AI governance, Responsible AI, model risk, compliance, and operational controls.
  • Ability to communicate complex technical concepts to both technical and business stakeholders.

More like this

Similar roles

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +3 58 days ago $90,000$157,500
Generative AI LLMs RAG Machine Learning AWS Azure Google Cloud Platform Vector Databases Microservices API Architecture Distributed Systems Event-Driven Architecture DevSecOps System Integration Enterprise Architecture Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Assistant Vice President

State Street

Quincy, MA +3 25 days ago $90,000$157,500
Generative AI LLMs RAG Machine Learning AWS Azure Google Cloud Platform Vector Databases Microservices API Architecture Distributed Systems Event-Driven Architecture DevSecOps System Integration Enterprise Architecture Cloud-Native Services
8+ yrs exp

AI Systems Design Architect, Vice President

State Street

Quincy, MA 59 days ago $120,000$217,500
Generative AI LLMs RAG Vector Databases AWS Azure Google Cloud Platform Microservices Distributed Systems API Architecture DevSecOps CI/CD Platform Engineering Prompt Orchestration Cloud-Native Architecture Observability Monitoring
10+ yrs exp

Senior Solution Architect, AI & Cloud Systems, Vice President

State Street

Quincy, MA +1 24 days ago $120,000$202,500
Generative AI Agentic AI AWS Databricks Python Kubernetes RAG LLMs Vector Databases Microservices APIs Event-Driven Architecture Kafka Apache Airflow Terraform OpenShift CI/CD DevSecOps LangChain LangGraph
10+ yrs exp

Senior AI Engineer Vice President

Citi

Remote (Jersey City, NJ) 10 days ago $142,320$213,480
Python GenAI LLMs RAG LangChain LangGraph FastAPI Kubernetes Docker Microservices REST APIs SQL Java Spring Boot React Angular CI/CD Distributed Systems Knowledge Graphs Transformer Architecture
6+ yrs exp Remote