JobsSenior Software Engineer - CoreAI Model Inference & Serving
Senior Software Engineer - CoreAI Model Inference & Serving
MicrosoftSenior Software Engineer - CoreAI Model Inference & Serving
MicrosoftLocation
USA (Multiple Locations)
Type
Full-time
Posted
5/5/2026
Compensation
$119,800 - $304,200 per year
Undergraduate with 5+ Years of Experience
Approval 98.4%·Filings 6,363·New hires 3,142·
👑 Elite Sponsor
·FY 2025Job description
Join the CoreAI team as a Senior Software Engineer, where you will contribute to building the AI data-plane that supports LLM inferencing workloads for Microsoft and Azure customers. This role focuses on developing large-scale AI services that enhance product experiences with ultra-low latency and high reliability. You will work alongside world-class engineers to drive innovation in AI systems. This position offers immense opportunities for learning and impact in a rapidly evolving field.
Requirements
- Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience with coding in languages including C, C++, C#, or Java.
- Ability to meet Microsoft, customer, and/or government security screening requirements.
Responsibilities
- Design, code, and ship core serving systems and smart routing for a broad portfolio of LLMs.
- Build large-scale AI services and platform capabilities that power new products and customer experiences.
- Drive innovation in AI systems alongside engineers and cross-functional partners.
- Lead through architecture, code reviews, mentorship, and technical excellence.
- Improve reliability, scalability, observability, efficiency, and performance across mission-critical services.
Benefits
- Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.
Is this posting expired or inaccurate?
