JobsPrincipal Software Engineering Manager - Substrate Efficiency
Microsoft logo

Principal Software Engineering Manager - Substrate Efficiency

Microsoft

Location

Redmond, WA

Type

Full-time

Posted

5/22/2026

Compensation

$142,800 - $304,200 per year

Undergraduate with 5+ Years of Experience
Approval 98.4%·Filings 6,363·New hires 3,142·
👑 Elite Sponsor
·FY 2025

Job description

The Principal Software Engineering Manager will lead a high-impact engineering team focused on optimizing AI inference performance within Microsoft 365 Copilot. This role involves maximizing throughput per GPU and driving efficiency in model execution and runtime performance. The team operates one of the largest AI inference platforms globally, delivering intelligent capabilities to millions of users. The position is based in Redmond, WA, and requires in-office work at least three days a week.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements.
  • 4+ years of people management experience.
  • Experience leading engineering teams building backend or distributed systems.
  • Hands-on experience improving system throughput, performance, and resource utilization across large-scale infrastructure.

Responsibilities

  • Build and lead a high-performing engineering team focused on inference runtime efficiency and model execution performance.
  • Define and drive strategy to improve throughput per GPU through runtime optimizations.
  • Increase engineering agility, enabling faster experimentation, iteration, and rollout of performance improvements.
  • Partner across M365 Core, AI Core, Azure, and Microsoft Research to co-design and productionize advanced inference optimizations.
  • Establish metrics, telemetry, and experimentation frameworks to measure efficiency gains and guide investment decisions.

Benefits

  • Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.

Is this posting expired or inaccurate?