Job Description

Microsoft AI is seeking a Member of Technical Staff, Evaluations Engineer to develop evaluation infrastructure for generative AI, focusing on large-scale GPU clusters. The ideal candidate will contribute to AI model development and embody a positive, collaborative culture.

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience
OR equivalent experience
Experience with generative AI
Experience with distributed computing
Experience in leading technical projects and supporting architectural decisions with data

Responsibilities

Develop and tune the pretraining scalable software for Nvidia GB200 72NVL CX8 and AMD MIxxx architectures
Benchmark GB200 and AMD MIxxx GPU clusters
Gather data and insights to develop the pretraining compute roadmap
Care deeply about conversational AI and its deployment
Actively contribute to the development of AI models that are powering our innovative products
Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively
Enjoy working in a fast-paced, design-driven, product development cycle
Embody our Culture and Values