JobsPrincipal Software Engineer, CoreAI
Microsoft logo

Principal Software Engineer, CoreAI

Microsoft

Location

Redmond, WA

Type

Full-time

Posted

5/5/2026

Compensation

$139,900 - $331,200 per year

Undergraduate with 5+ Years of Experience
Approval 98.4%·Filings 6,363·New hires 3,142·
👑 Elite Sponsor
·FY 2025

Job description

The Principal Engineer role at CoreAI focuses on shaping the architecture and strategy for monitoring, troubleshooting, and scaling AI training workloads. The AI Core Infrastructure team is responsible for managing GPU infrastructure and supporting various Microsoft AI workloads. This position involves working with ML infrastructure, distributed systems, and observability to enhance large-scale AI supercomputing capabilities. The role emphasizes collaboration, mentorship, and driving technical excellence within the team.

Requirements

  • Bachelor's Degree in Computer Science or related technical field.
  • 6+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements.
  • Expertise with distributed observability technologies and experience designing or scaling telemetry pipelines for high-throughput production systems.
  • Advanced experience with production ML systems and large-scale training infrastructure.
  • 6+ years of experience building or operating distributed systems with a focus on reliability, scalability, and performance.
  • Understanding of Docker, Kubernetes, scalable architectures, and automation for production systems.

Responsibilities

  • Set the roadmap and drive the execution of the training infrastructure built for AI workloads at a supercomputer scale.
  • Design, develop, and ship the backend services that power the AI workloads.
  • Deliver deep insights that empower customers to troubleshoot and optimize their large-scale AI workloads.
  • Collaborate closely with engineers and data scientists across Microsoft’s internal research teams to shape the infrastructure.
  • Leverage production telemetry to influence next-generation infrastructure design, boosting efficiency, reliability, and performance.
  • Mentor and guide engineering teams, elevating technical excellence and championing a customer-focused approach to system design.

Benefits

  • Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.

Is this posting expired or inaccurate?