Senior Machine Learning Infrastructure Engineer - DGX Cloud

Job Description

NVIDIA is seeking engineers to scale up its AI Infrastructure by developing leading infrastructure solutions for a broad range of AI-based applications.

Requirements

• 5+ years of software engineering experience on large-scale production systems.
• BS in Computer Science/Engineering/Physics/Mathematics or other comparable Degree or equivalent experience.
• Expert level knowledge of a systems programming language (Go, Python) and a solid understanding of Data Structure and Algorithms.
• Strong background of Linux system administration and management.
• Background with cluster management systems (Kubernetes, SLURM).
• Understanding of performance, security and reliability in complex distributed systems.
• Familiarity with system level architecture, data synchronization, fault tolerance and state management.

Responsibilities

• Automate GPU asset provisioning, configuration, and lifecycle management across cloud providers.
• Contribute to building end-to-end automation of datacenter operations, break/fix, and lifecycle management for large-scale Machine Learning systems.
• Implement monitoring and health management capabilities for industry-leading reliability, availability, and scalability of GPU assets.
• Build automated test infrastructure to qualify distributed systems for operation.
• Partner with engineering teams to ensure software integration from hardware to AI training applications.

Benefits

• Multiple relocation packages
• Two weeklong shutdowns (mid-summer and year-end) in the US (in addition to PTO)
• 8-week parental leave
• 9 Employee Resource Groups
• Annual bonus offering
• Flexible work arrangements
• Up to 6% 401K matching