The Senior Applied Scientist role at Microsoft focuses on advancing the Outlook team's Copilot efforts in Large Language Model (LLM) evaluation, relevance, and Responsible AI. The position involves developing infrastructure and measurement frameworks while collaborating with various stakeholders to enhance LLM systems. The successful candidate will leverage data science and AI expertise to drive decision-making and improve user experiences. This role emphasizes strategic leadership, program management, and cross-functional collaboration to ensure effective evaluation processes.

• Bachelor's degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience.
• Master's degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience.
• Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year related experience.
• Ability to meet Microsoft, customer and/or government security screening requirements.

• Develop and execute a comprehensive strategy for LLM evaluation, including quality, costs, and responsible AI considerations.
• Oversee and manage large-scale, cross-functional evaluation programs to ensure alignment with organizational objectives.
• Utilize data science skills to design experiments, analyze data, and derive actionable insights to enhance LLM systems.
• Lead efforts to assess and improve the performance of language models and agents.
• Collaborate with User Experience teams to evaluate and optimize user interactions with AI systems.
• Implement Responsible AI principles in AI systems to ensure ethical practices.
• Form partnerships and lead research initiatives in LLM evaluation and user experience optimization.
• Work with engineering, research, and product teams to integrate evaluation processes into the development lifecycle.
• Communicate findings and recommendations to executive leadership to foster a data-driven culture.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.