NVIDIA is seeking exceptional AI systems engineers to innovate and develop technologies in the inference systems software stack. The team focuses on creating advanced AI systems software to enhance AI inference capabilities. Engineers will work on libraries, code generators, and GPU kernel technologies tailored for NVIDIA's hardware architecture. This role involves designing new abstractions and optimizing components for large language models and high-impact AI workloads.

• Masters degree in Computer Science, Electrical Engineering, or related field, with a preference for PhD candidates.
• At least 2 years of experience in ML/DL systems development, either academic or industry.
• Strong experience in developing or using deep learning frameworks such as PyTorch, JAX, TensorFlow, or ONNX.
• Proficiency in Python and C/C++ programming languages.
• Experience in GPU kernel development and performance optimizations, particularly using CUDA C/C++, cuTile, or Triton.

• Innovate and develop new AI systems technologies for efficient inference.
• Design, implement, and optimize kernels for high impact AI workloads.
• Create extensible abstractions for LLM serving engines.
• Build efficient just-in-time domain specific compilers and runtimes.
• Collaborate closely with other engineers across deep learning frameworks, libraries, kernels, and GPU architecture teams.
• Contribute to open source communities like FlashInfer, vLLM, and SGLang.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.