Location
Redmond, WA, Boston, MA, Mountain View, CA
Type
Full-time
Posted
8/18/2026
Compensation
$165,600 - $331,200 per year
Job description
The Senior AI Software Architect role is part of the AI Systems Architecture group within Microsoft's Azure Hardware Systems and Infrastructure organization. This team focuses on defining, validating, and optimizing next-generation AI systems across hardware, software, and cloud-scale deployments. The architect will drive software bring-up, performance analysis, and optimization for AI accelerators, collaborating with various teams to enhance the efficiency and scalability of AI workloads. The position emphasizes a blend of technical expertise and strategic insight to support Microsoft's cloud growth.
Requirements
- Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python.
- Ability to meet Microsoft, customer, and/or government security screening requirements.
- PhD in Computer Science, Computer Architecture, Electrical Engineering, Machine Learning, High-Performance Computing, or a related field is preferred.
- Experience designing, building, or optimizing systems software for AI, machine learning, high-performance computing, or distributed systems is preferred.
Responsibilities
- Lead end-to-end software architecture and performance optimization for AI accelerator platforms.
- Prototype and validate software capabilities across kernels, compiler and runtime layers, distributed training and inference frameworks, and serving infrastructure.
- Analyze workload behavior at scale to identify performance bottlenecks, numerical correctness issues, and system-level efficiency opportunities.
- Use workload insights to guide hardware-software co-design decisions across architecture, silicon, systems software, networking, and product teams.
- Define requirements, evaluate tradeoffs, and deliver practical solutions for production-scale AI systems.
Benefits
- Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.
Is this posting expired or inaccurate?
