JobsSenior Software Engineer - CoreAI Model Inference & Serving
Microsoft logo

Senior Software Engineer - CoreAI Model Inference & Serving

Microsoft

Location

USA (Multiple Locations)

Type

Full-time

Posted

5/5/2026

Compensation

$119,800 - $304,200 per year

Undergraduate with 5+ Years of Experience
Approval 98.4%·Filings 6,363·New hires 3,142·
👑 Elite Sponsor
·FY 2025

Job description

Join the CoreAI team as a Senior Software Engineer, where you will contribute to building the AI data-plane that supports LLM inferencing workloads for Microsoft and Azure customers. This role focuses on developing large-scale AI services that enhance product experiences with ultra-low latency and high reliability. You will work alongside world-class engineers to drive innovation in AI systems. This position offers immense opportunities for learning and impact in a rapidly evolving field.

Requirements

  • Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience with coding in languages including C, C++, C#, or Java.
  • Ability to meet Microsoft, customer, and/or government security screening requirements.

Responsibilities

  • Design, code, and ship core serving systems and smart routing for a broad portfolio of LLMs.
  • Build large-scale AI services and platform capabilities that power new products and customer experiences.
  • Drive innovation in AI systems alongside engineers and cross-functional partners.
  • Lead through architecture, code reviews, mentorship, and technical excellence.
  • Improve reliability, scalability, observability, efficiency, and performance across mission-critical services.

Benefits

  • Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.

Is this posting expired or inaccurate?