NVIDIA is seeking an experienced professional to lead the architecture and development of communication libraries for next-generation platforms. This role focuses on optimizing communication primitives for AI and HPC applications, ensuring they meet the demands of advanced workloads. The successful candidate will collaborate with application developers and hardware architects to influence specifications and enhance performance. This position offers the opportunity to work in a diverse and innovative environment, contributing to groundbreaking advancements in AI and computing.

• Ph.D. or M.S. in Computer Science, Electrical Engineering, or a related field with 12+ years of industry experience in high-performance computing or distributed deep learning.
• Deep understanding of 3D parallelism and advanced strategies including Context Parallelism, Expert Parallelism, and Zero Redundancy Optimizer variants.
• Deep technical proficiency with NCCL, UCX, UCC, NVSHMEM, or MPI, along with experience in RDMA, RoCE, and low-level InfiniBand verbs.
• Advanced knowledge of high-throughput inference engines and schedulers, specifically TensorRT-LLM, vLLM, SGLang, and NVIDIA Dynamo.
• Expert knowledge of the NVIDIA GPU memory hierarchy and CUDA programming models.

• Define the long-term technical roadmap for communication libraries across NVIDIA’s next-generation platforms.
• Lead the development of next-generation communication primitives and collective algorithms.
• Partner with application developers to architect and implement specialized communication primitives.
• Collaborate with silicon architects and software engineers to influence hardware specifications for next-generation networking.
• Develop high-fidelity analytical models and simulators to predict system behavior under emerging workloads.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.