Principal Software Engineering - Performance
Microsoft Mountain View, CA Full-time 3/24/2026 $139.9k - $331.2k per year
Undergraduate with 5+ Years of ExperienceMaster's with 2+ Years of Experience
Approval 98.4%•Total filings 6,363•New hires 3,142•
👑 Elite Sponsor
•FY 2025Job Description
The Principal Engineer role in the Artificial Intelligence Cloud Inference team at Microsoft involves optimizing AI model performance across various platforms, including GPUs and Microsoft hardware. The position requires hands-on software design and development skills, focusing on improving inference performance for state-of-the-art LLMs and collaborating with internal and external partners.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
Responsibilities
- Identify and drive improvements to end-to-end inference performance of OpenAI and other state of the art LLMs.
- Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon.
- Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities.
- Enable fast time to market of LLMs/models and their deployments at scale by building SW tools.
- Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools.
- Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems.
- Communicate and collaborate with our partners both internal and external.
- Embody Microsoft's Culture and Values.
Benefits
- Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.
Is this job posting expired or no longer available?