The role involves developing innovative AI systems technologies focused on efficient inference for NVIDIA's hardware architecture. As an AI systems engineer, you will work on libraries, code generators, and GPU kernel technologies. The position requires collaboration with other engineers across various teams to enhance deep learning frameworks and contribute to open source communities. The main focus is on optimizing kernels and building extensible abstractions for large language model serving engines.

• Masters degree in Computer Science, Electrical Engineering, or related field, with a preference for PhD candidates.
• 6+ years of experience in ML/DL systems development.
• Strong experience in developing or using deep learning frameworks such as PyTorch, JAX, TensorFlow, and ONNX.
• Strong programming skills in Python and C/C++.
• Strong experience in GPU kernel development and performance optimizations, particularly using CUDA C/C++, cuTile, Triton, or similar.

• Innovate and develop new AI systems technologies for efficient inference.
• Design, implement, and optimize kernels for high impact AI workloads.
• Design and implement extensible abstractions for LLM serving engines.
• Build efficient just-in-time domain specific compilers and runtimes.
• Collaborate closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU architecture teams.
• Contribute to open source communities like FlashInfer, vLLM, and SGLang.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.