The Senior AI Hardware Architect role at Microsoft focuses on optimizing next-generation AI accelerator platforms and large-scale AI systems. The position is part of the AI Systems Architecture group within the Azure Hardware Systems and Infrastructure organization. The architect will analyze AI workloads, identify performance bottlenecks, and drive performance optimizations across hardware and software. Collaboration with various teams is essential to shape future AI architectures and improve efficiency and scalability.

• Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 3+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 5+ years technical engineering experience OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements.

• Lead performance analysis, profiling, benchmarking, and analytical modeling across GPU and AI accelerator architectures.
• Analyze end-to-end AI workloads and serving systems to understand performance, scalability, efficiency, and cost drivers.
• Develop performance, efficiency, and system-level models to evaluate new architectural features and innovations.
• Correlate silicon measurements, software traces, and kernel execution behavior with architectural models.
• Drive kernel-level, runtime-level, and system-level performance optimizations across AI training and inference workloads.
• Design and develop data analysis, correlation, visualization, and performance modeling tools.
• Partner closely with architecture, microarchitecture, compiler, runtime, networking, and systems teams.
• Present performance findings and architectural recommendations to senior technical leadership.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.