Principal AI and ML Infra Software Engineer, GPU Clusters

Job Description

Join NVIDIA as a Principal AI and ML Infra Software Engineer, GPU Clusters to enhance efficiency for researchers by implementing progressions throughout the stack and enabling groundbreaking AI and ML research on GPU Clusters.

Requirements

• BS or similar background in Computer Science or related area (or equivalent experience)
• 15+ years of demonstrated expertise in AI/ML and HPC tasks and systems
• Hands-on experience in using or operating High Performance Computing (HPC) grade infrastructure
• Capability in supervising and improving substantial distributed training operations using PyTorch, NeMo, or JAX
• Proficiency in programming & scripting languages such as Python, Go, Bash
• Dedication to ongoing learning and staying updated on new technologies and innovative methods in the AI/ML infrastructure sector
• Excellent communication and collaboration skills

Responsibilities

• Engage closely with AI and ML research teams to discern their infrastructure requirements and barriers
• Proactively identify researcher efficiency bottlenecks and lead initiatives to improve it
• Monitor and optimize the performance of infrastructure ensuring high availability, scalability, and efficient resource utilization
• Define and improve important measures of AI researcher efficiency
• Work closely with various teams to develop a cohesive AI/ML infrastructure ecosystem
• Keep up to date with recent developments in AI/ML technologies and advocate for their integration

Benefits

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.