The Senior Software Engineer role at Microsoft focuses on building the AI inferencing platform that supports Microsoft's Large Language Model services. The position is part of the M365 Core AI Inferencing Engineering team, which is dedicated to creating high-performance, cost-efficient AI infrastructure. The team collaborates across Microsoft to solve complex technical challenges and deliver innovative AI experiences. This is an opportunity to work on cutting-edge AI technologies that impact millions of users.

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
• Ability to meet Microsoft, customer and/or government security screening requirements.
• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python is preferred.
• Solid coding skills in Python and/or C#, .Net.
• Experience with LLMs, orchestrators, embedding models, and vector databases.

• Lead the design, implementation, and delivery of LLM API management service for millions of customers.
• Manage cost and availability to set the benchmark for the industry.
• Coach your team for building and running large scale platforms and experiences that get used by hundreds of millions of users every day.
• Work independently and collaboratively with other product teams across Power Platform, BizApps, and Microsoft.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.