Principal Machine Learning Engineer - CoreAI

Job Description

Microsoft is seeking a Principal Machine Learning Engineer - CoreAI with experience in large-scale model deployment and production systems. The role involves building and optimizing production systems for various AI models, ensuring model reliability, inference performance, and scalability in production environments.

Requirements

• Doctorate in relevant field with 3+ years of related research experience OR equivalent experience
• 3+ years of coding experience in Python and experience with ML frameworks such as PyTorch and Triton
• Proven ability to design and scale training infrastructure and pipelines in production environments
• Experience in production ML systems, especially on finetuning LLMs, SLMs, multimodal, or code-specific models
• Expertise in system architecture and scalability, designing and implementing large-scale distributed systems
• Proficiency in building and maintaining ML production pipelines
• Ability to meet Microsoft, customer, and/or government security screening requirements

Responsibilities

• Design and implement large-scale model training for LLMs, SLMs, multimodal, or code-specific models
• Optimize system performance for training and inference workloads
• Write efficient, production-quality code and debug complex distributed systems
• Integrate with both proprietary and open-source frameworks to build robust ML pipelines
• Design and implement scalable serving infrastructure for various AI models
• Contribute to or build on existing innovations in AI solutions

Benefits

• Industry leading healthcare
• Educational resources
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect