NVIDIA is seeking a Deep Learning Communication Architect to join their software architecture group. This role focuses on optimizing communication performance and designing efficient communication protocols for deep learning workloads. The architect will collaborate with hardware and software teams to enhance the performance and scalability of deep learning systems. The position offers an opportunity to work in a diverse and innovative environment, contributing to cutting-edge technology in AI and computing.

• A Ph.D., Masters, or BS in Computer Science, Electrical Engineering, or a closely related field.
• 6+ years of experience in building and scaling deep neural networks.
• Experience in evaluating and optimizing LLM training and inference performance.
• Deep understanding of parallelism techniques in deep learning.
• Proficiency in developing code for deep neural network training and inference frameworks.
• Strong programming skills in C++ and Python.
• Familiarity with GPU computing, including CUDA and OpenCL.

• Identify and eliminate bottlenecks in data transfer and synchronization during distributed deep learning training and inference.
• Develop and implement communication algorithms and protocols tailored for deep learning workloads.
• Collaborate with hardware and software teams to craft systems that effectively apply high-speed interconnects and communication libraries.
• Research and evaluate new communication technologies to enhance deep learning system performance.
• Build proofs-of-concept, conduct experiments, and perform quantitative modeling to validate new communication strategies.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.