Senior Software Architect - Deep Learning and HPC Communications

Job Description

NVIDIA is seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software for AI and HPC workloads.

Requirements

• M.S./Ph.D. degree in CS/CE or equivalent experience
• 5+ years of relevant experience
• Excellent C/C++ programming and debugging skills
• Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC)
• Deep understanding of operating systems, computer and system architecture
• Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads
• Strong experience with Linux
• Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment

Responsibilities

• Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems
• Design and implement new communication technologies to accelerate AI and HPC workloads
• Explore innovative solutions in HW and SW for next-generation platforms as part of co-design efforts involving GPU, Networking, and SW architects
• Build proofs-of-concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations
• Use simulation to explore performance of large GPU clusters

Benefits

• Multiple relocation packages
• Two weeklong shutdowns (mid-summer and year-end) in the US (in addition to PTO)
• 8-week parental leave
• 9 Employee Resource Groups
• Annual bonus offering
• Flexible work arrangements
• Up to 6% 401K matching