The Member of Technical Staff – Capacity & Efficiency Infrastructure at Microsoft AI will focus on improving the efficiency of the compute fleet by building software and mathematical models. This role involves collaborating with ML researchers and engineers to enhance distributed training infrastructure and optimize GPU performance. The team operates within a startup-like environment, pushing the boundaries of AI toward Humanist Superintelligence. Candidates should bring a positive attitude and a strong technical background to contribute to innovative AI solutions.

• Bachelor’s Degree in Computer Science or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
• Deep understanding of the fundamentals of GPU architectures and DL/LLM architectures.
• Experience with low-level GPU programming (CUDA, Triton, NCCL) and frameworks such as PyTorch or JAX.
• Experience in networking (InfiniBand, NVLink), storage systems, or distributed training parallelisms.

• Design, implement, test, and optimize distributed training infrastructure in Python and C++ for large-scale GPU clusters.
• Build and evolve telemetry systems to provide visibility into infrastructure and ML model performance.
• Profile, benchmark, and debug performance bottlenecks across compute, memory, networking, and storage subsystems.
• Drive architectural improvements across various ML services which deliver measurable efficiency improvements.
• Collaborate with hardware teams to optimize for next-generation accelerators.

• Employees at Microsoft are often offered comprehensive, “world-class” benefits—including health and mental-wellness programs, competitive pay with bonuses and stock awards, and retirement/savings options. Time-off and flexibility are common, with generous vacation and holidays, parental and caregiver leave, and flexible work schedules, alongside learning support, employee resource groups, product discounts, and matching-gifts/volunteering programs. Specific benefits can vary by region.