JobsPrincipal AI Performance Architect
Microsoft logo

Principal AI Performance Architect

Microsoft

Location

Mountain View, CA, Redmond, WA, Boston, MA

Type

Full-time

Posted

11/18/2026

Compensation

$142,800 - $304,200 per year

Undergraduate with 5+ Years of Experience
H-1B FY202696.0% approval-64% YoY
👑 Elite sponsor

Job description

The Principal AI Performance Architect role at Microsoft focuses on shaping the next generation of AI systems within the Azure Hardware Systems and Infrastructure organization. This position involves analyzing training and inference workloads, developing analytical models, and validating performance assumptions on silicon. The role requires collaboration with various teams to guide hardware-software co-design decisions for cloud-scale AI systems. The ideal candidate will contribute to the innovation of Microsoft’s cloud growth by leveraging technical expertise and business insight.

Requirements

  • Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements.

Responsibilities

  • Analyze Frontier training and inference workloads to identify key performance requirements and bottlenecks.
  • Develop and improve analytical models, simulators, and data-analysis tools for AI system performance.
  • Evaluate trade-offs in performance, scalability, utilization, capacity, and cost across accelerator, memory, network, and software configurations.
  • Study hardware-software interactions in large-scale AI systems and translate workload insights into architecture requirements.
  • Work with MSI and partner teams to evaluate hardware-software co-design options for training and inference.
  • Develop and run targeted microbenchmarks on silicon to measure compute, memory, communication, kernel, and synchronization performance.
  • Compare model predictions with silicon and end-to-end workload measurements, identify gaps, and improve model accuracy.
  • Communicate findings and recommendations through clear data visualizations, technical reports, and architecture decision materials.

Benefits

  • Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.

H-1B filing history

Public USCIS petition and DOL LCA counts · latest USCIS FY2026, LCA FY2026

Filing entity: Microsoft Corporation

As of Aug 23, 2026

Initial approvals

503

FY2026

Approval rate

96.0%

FY2026

LCA certified

3,062

FY2026

Entry-level share

5.7%

FY2026

Initial approvals YoY

-64%

Trend

LCA certified YoY

-83%

Trend

Initial approvals by fiscal year

Approval rate by fiscal year

Continuing vs initial approvals

LCA certified positions by quarter

LCA certified positions by fiscal year

Based on public USCIS and DOL filings; not a sponsorship guarantee.

Is this posting expired or inaccurate?