The Copilot Offline Evaluation Platform (COEP) team is looking for a Senior Applied Scientist to enhance offline evaluations that reflect real customer experiences. This role involves developing scientific methods to extract query patterns, generate synthetic evaluation data, and improve the alignment between offline evaluations and online experiments. The candidate will work closely with engineering, product, and research teams to create scalable capabilities for evaluating AI systems. The position emphasizes a collaborative culture that values innovation and inclusion.

• Bachelor's Degree in Statistics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience.
• Master's Degree in Statistics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience.
• Doctorate in Statistics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience.
• Ability to meet Microsoft, customer and/or government security screening requirements.

• Frame complex product and customer problems as applied science opportunities with clear success metrics.
• Design, build, and evaluate machine learning and AI models, algorithms, and experimentation frameworks.
• Develop robust data, training, evaluation, and inference pipelines suitable for production use.
• Conduct rigorous offline and online experiments; analyze results and communicate actionable recommendations.
• Partner with software engineers and product managers to integrate scientific solutions into products and services.
• Improve model quality, reliability, efficiency, safety, and responsible AI practices throughout the lifecycle.
• Provide technical leadership through design reviews, mentoring, and raising the scientific bar for the team.
• Stay current with relevant research and identify opportunities to apply new methods to customer needs.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.