The Software Engineer II role at Microsoft focuses on building the AI inferencing platform that supports Microsoft's AI technologies. The position is part of the M365 Core AI Inferencing Engineering team, which is dedicated to creating high-performance AI infrastructure. The team collaborates across Microsoft to tackle complex challenges and deliver innovative AI experiences. Candidates will work on cutting-edge technologies that impact millions of users while fostering a culture of inclusion and continuous learning.

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements.
• Solid coding skills in Python and/or C#, .Net.
• Experience with LLMs, orchestrators, embedding models, and vector databases.

• Lead the design, implementation, and delivery of LLM API management service for millions of customers.
• Maniacally manage cost and availability – set the benchmark for the industry.
• Coach your team for building and running large scale platforms and experiences that get used by hundreds of millions of users every day.
• Work independently and collaboratively with other product teams across Power Platform, BizApps, and Microsoft.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.