Data Scientist II, M365 Copilot

What you'll do

• Build and deliver model-driven features from initial concept through production using A/B testing and evaluation metrics.
• Evolve orchestrator systems to improve reasoning, speed, and multi-modality capabilities for agent-based systems.
• Define metrics and frameworks for evaluating complex LLM systems and agentic product performance.
• Experiment with different models and prompting approaches to optimize specific tasks within a product.
• Prototype and develop AI models using containerized environments like Azure Foundry and LangChain.
• Develop and deploy retrieval-augmented generation (RAG) workflows by selecting appropriate data sources and generative models.
• Diagnose system issues and identify opportunities to improve performance within the LLM domain.

What we're looking for

• Bachelor's degree in a quantitative field and 2+ years of data science experience or a Master's degree and 1+ year of experience.
• A Doctorate in Data Science, Mathematics, Statistics, Economics, or a related field is accepted as a qualifying education.
• Experience managing structured and unstructured data while applying statistical techniques and reporting results.
• Ability to pass the Microsoft Cloud background check every two years.
• Experience with deep learning, NLP, multimodality models, and model optimization (preferred).
• Experience with advanced data science roles is preferred based on specific degree levels and years of experience (preferred).