NVIDIA is seeking exceptional AI systems engineers to innovate and develop technologies in the inference systems software stack. The role involves creating libraries, code generators, and GPU kernel technologies specifically for NVIDIA's hardware architecture. Engineers will focus on designing efficient abstractions and optimizing kernels for high-impact AI workloads, particularly in large language models. Collaboration with other engineers across various teams is essential, as well as contributing to open source communities.

• Masters degree in Computer Science, Electrical Engineering, or a related field, with a preference for PhD candidates.
• 6+ years of experience in ML/DL systems development, either academic or industry.
• Strong experience in developing or using deep learning frameworks such as PyTorch, JAX, TensorFlow, and ONNX.
• Proficiency in Python and C/C++ programming.

• Innovate and develop new AI systems technologies for efficient inference.
• Design, implement, and optimize kernels for high-impact AI workloads.
• Design and implement extensible abstractions for LLM serving engines.
• Build efficient just-in-time domain specific compilers and runtimes.
• Collaborate closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU architecture teams.
• Contribute to open source communities like FlashInfer, vLLM, and SGLang.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.