The role is for a Senior Software Engineer on the Microsoft Azure AI Inference team, focusing on designing, optimizing, and scaling inference systems for AI models. The team is responsible for serving internal and external machine learning workloads and solving real-world inference challenges. The engineer will influence product development and drive new features from preview to general availability. This position offers the opportunity to work on cutting-edge AI scenarios and contribute to a culture of inclusion and collaboration.

• Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience with coding in languages including C, C++, C#, or Java.
• Ability to meet Microsoft, customer, and/or government security screening requirements.

• Design and implement core inference infrastructure for serving frontier AI models in production.
• Identify and drive improvements to end-to-end inference performance and efficiency of state-of-the-art LLMs and GenAI models.
• Design and implement efficient load scheduling and balancing strategies.
• Scale the platform to support growing inferencing demand and maintain high availability.
• Deliver critical capabilities required to serve the latest Gen AI models.
• Drive generic features to cater to the needs of customers such as GitHub and Microsoft AI.
• Collaborate with internal and external partners.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.