Senior Software Engineer - AI Frameworks

Job Description

Senior Software Engineer role at Microsoft's Artificial Intelligence (AI) Frameworks team focusing on developing AI software for running AI models on various devices and platforms.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including C/C++, Python OR equivalent experience
• 2+ years’ practical experience working on high performance applications and performance debug and optimization on CPU's/GPU's
• Experience in DNN/LLM inference and experience in one or more deep learning frameworks such as PyTorch, Tensorflow, or ONNX Runtime and familiarity with CUDA, ROCm, Triton
• Ability to meet Microsoft, customer and/or government security screening requirements

Responsibilities

• Identify and drive improvements to end-to-end inference performance of OpenAI and other state of the art LLMs
• Measure, benchmark performance on Nvidia/AMD GPU's and first-party Microsoft silicon
• Optimize and monitor performance of LLMs and build software tooling to enable insights into performance opportunities
• Enable fast time to market of LLMs/models and their deployments at scale by building software tools
• Design, implement, and test functions or components for AI/deep neural networks (DNN)/LLM frameworks and tools
• Communicate and collaborate with partners both internal and external

Benefits

• Industry leading healthcare
• Educational resources
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect