The Principal Software Engineer will lead the technical vision for the Copilot offline evaluation platform, focusing on delivering trustworthy results across complex dependencies. This role involves architecting an AI-first and agentic-first evaluation platform that enables autonomous agents to operate and extend the system. The engineer will shape the evaluation strategy for one of the world's most visible AI products while mentoring other engineers and driving modernization efforts. The position requires a strong background in large-scale AI systems and reliability engineering.

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements.

• Set the technical direction for the Copilot offline evaluation platform and partner with teams across the Copilot organization.
• Lead the architecture of an AI-first, agentic-first evaluation platform where autonomous agents are first-class operators.
• Own the platform's challenge of delivering trustworthy results across a deep chain of dependencies.
• Define how Copilot's agentic experiences are evaluated end to end, including multi-turn trajectories and task outcomes.
• Mentor engineers across teams to build extensible, maintainable systems and drive modernization of the evaluation runtime.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.