The Senior/Principal Software Engineer role within AI Infra at Microsoft focuses on building foundational platforms and services for AI workloads. The team is dedicated to enhancing developer productivity and creating intelligent software solutions using Generative AI. Engineers will work on high-scale distributed services for model training and inference, ensuring high availability and performance. The position emphasizes collaboration with internal and external teams to deliver innovative solutions.

• Bachelor's Degree in Computer Science or related technical field AND 4+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
• Master's Degree in Computer Science or related technical field AND 8+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR Bachelor's Degree in Computer Science or related technical field AND 12+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
• Knowledge and first-hand experience with large model training systems.
• 3+ years of experience operating and designing systems that support large model training.
• Experience in distributed systems and architecture.
• AI infrastructure and workload knowledge.

• Work on the architecture, design, and development of core compute services powering AzureML to tackle challenging AI problems using state-of-the-art LLM models.
• Develop, test, and maintain backend services written in C#, Go, Rust, C++, hosted on Kubernetes clusters and Docker containers.
• Enhance systems and applications to ensure high stability, efficiency, and maintainability, low latency, and tight cloud security.
• Provide operational support and DRI responsibilities for the product.
• Collaborate closely with engineers and data scientists within the team, as well as internal Microsoft Research teams and external enterprises.
• Provide vision, expertise, and technical leadership to other team members.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.