Join Microsoft’s AI Core team, which focuses on building high-performance runtime systems that support OpenAI chat and multimodal AI models at scale. This role emphasizes systems-level optimization for large-scale LLM inferencing, requiring deep expertise in C++. The team is responsible for enhancing the efficiency and reliability of AI inferencing systems while collaborating with various partners to integrate model inference pipelines.

• 6+ years of experience in systems programming with strong expertise in C++.
• Proven experience building, deploying, and operating scalable cloud services.
• Strong debugging skills and experience using performance profiling and diagnostic tools.
• Hands-on experience with distributed systems, Kubernetes, and containerized workloads.
• Experience with large-scale LLM inferencing infrastructure, including CUDA.
• Ability to meet Microsoft, customer and/or government security screening requirements.

• Design and implement high performance microservices and runtime components in C++.
• Optimize AI inferencing systems for latency, throughput, cost, and reliability at large scale.
• Debug and resolve complex production issues related to performance, scaling, and service reliability.
• Collaborate with cross-functional partners to integrate model inference pipelines into scalable infrastructure.
• Contribute to state-of-the-art multimodal inferencing systems supporting text, speech, and vision workloads.
• Drive systems level innovations for real-time and batch inferencing efficiency.
• Participate in code reviews and provide technical mentorship to senior and peer engineers.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.