The Principal AI Software Engineer will join the Compute System Architecture (CSA) team within the System Planning and Architecture (SPARC) organization at Microsoft. This role focuses on innovating hardware and systems designs to enhance Azure's cloud capabilities. The engineer will lead software prototyping and collaborate with various teams to optimize total cost of ownership (TCO) for Azure deployments. The position requires deep technical expertise and a strategic approach to systems architecture and technology pathfinding.

• Bachelor's Degree in Computer Science or related technical field and 6+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
• Ability to meet Microsoft, customer and/or government security screening requirements.
• 12+ years of experience in systems software with a demonstrated track record of success.
• 10+ years of experience leading significant hardware/software co-design projects.
• Deep expertise in Linux kernel internals, memory management, and I/O subsystems.

• Lead full system software prototyping to develop proof-of-concepts for memory TCO reduction.
• Develop insights through workload characterization to identify systems optimization opportunities.
• Collaborate with workload experts to engineer TCO-optimized solutions for Azure.
• Influence hardware architecture and industry alignment with data-driven analysis.
• Lead optimization of Large Language Model inference workloads focusing on memory utilization.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.