As a Senior AI Service Architect on the ACES team, you will translate product specifications into scalable service architectures, focusing on agent workflows, data source integrations, and cost-effective model deployments. Your daily tasks include developing LLM-based solutions with prompt engineering and RAG pipeline design, building evaluation systems for agent correctness and safety, and deploying services using CI/CD pipelines while ensuring full production observability. You will work in C# and Python, implementing secure service patterns such as RBAC and secrets management, and integrating agents with Azure data sources to provide real-time signals. This role requires experience in low-code application development, AI solution management, programming, and CI/CD pipelines, along with a commitment to Responsible AI practices for safe, fair, and compliant outputs.
Translate product specs into AI service architectures, integrating data sources and designing scalable workflows.
Develop LLM-based solutions through prompt engineering, model selection, and cost optimization.
Build evaluation systems to validate agent correctness and safety before deployment.
Write production-quality code in C# and Python using test-driven development practices.
Deploy services with CI/CD pipelines, ensuring full observability for monitoring and tracing.
Implement secure service patterns including RBAC, Managed Identities, and secrets management.
Integrate agents with Azure data sources to ensure real-time signal grounding.
What we're looking for
2+ years of experience in low-code application development or equivalent
Proficient in C# and Python with test-driven development practices
Expertise in designing and optimizing LLM-based solutions and RAG pipelines
Experience managing AI solutions, including chatbots and prompt engineering
Strong background in CI/CD pipelines, automated testing, and production observability
Knowledge of secure service patterns, RBAC, Managed Identities, and secrets management
Bachelor's Degree required
Market check
Salary context
This listing doesn't show a salary. Similar roles on FindRole typically pay
$152,000–$234,800.
Peer median band
$152,000–$234,800
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$159,750–$246,150
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
451 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 417 roles with salary data.