The role involves joining the Core AI team at Microsoft, focusing on redefining software development through Generative AI. As a technical contributor, you will drive the applied science foundation for observability in AI agents and multi-agent systems. The main focus is on understanding agent behavior in production, including quality, safety, reliability, and evolution over time. You will develop scientific methods and evaluation frameworks to benchmark and improve agent-based systems.

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience.
• Master's Degree in a relevant field AND 3+ years related experience.
• Doctorate in a relevant field AND 1+ year(s) related experience.
• Ability to meet Microsoft, customer and/or government security screening requirements.

• Develop evaluation and measurement frameworks for single-agent and multi-agent systems.
• Design methodologies that connect offline evaluations, online signals, and production telemetry.
• Define scientifically grounded quality signals and benchmarks for agent systems.
• Build models and analysis techniques to detect regressions and characterize agent behavior.
• Advance observability for AI systems through new approaches to trace analysis and anomaly detection.
• Partner with engineering teams to operationalize evaluation and observability methods.
• Contribute to instrumentation and semantic standards for agent observability.
• Collaborate with product and platform teams to shape end-to-end experiences for evaluation and monitoring.
• Act as a technical leader by setting scientific direction and mentoring others.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.