Principal Software Engineering Manager - CoreAI

Job Description

The Principal Software Engineering Manager - CoreAI role at Microsoft involves leading a team building the backbone of generative AI infrastructure.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C#, Java, C++, Go
• 4+ years of experience managing software engineering teams
• 4+ years of experience with distributed systems, microservices, and container orchestration technologies (e.g., Kubernetes, Docker)
• 4+ years of experience with CI/CD pipelines and developer tooling (e.g., GitHub, Azure DevOps)
• 4+ years of experience building and maintaining infrastructure platforms and product APIs with a focus on usability, extensibility, scale and performance

Responsibilities

• Lead and grow a team of software engineers focused on building scalable, cloud-native inferencing services and orchestration layers.
• Partner with product, research, and platform teams to define requirements and deliver robust, extensible infrastructure platforms and product APIs.
• Drive architectural decisions and technical strategy for inferencing control systems, ensuring high availability, performance, and cost efficiency.
• Guide the team in designing and implementing distributed systems that support dynamic routing, load balancing, and execution of AI workloads.
• Ensure engineering excellence through code reviews, design reviews, and mentoring, fostering a culture of innovation and inclusion.
• Own the operational health of services, including on-call rotations, incident response, and continuous improvement of reliability metrics.
• Collaborate across CoreAI and Microsoft to align on platform integration, security, and compliance requirements.
• Champion developer experience and usability in SDKs and tooling, enabling seamless integration with agentic and generative AI platforms.

Benefits

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.