Senior Deep Learning Software Engineer, FlashInfer

Job Description

NVIDIA is seeking a Senior Deep Learning Software Engineer to work on developing groundbreaking AI systems technologies for efficient inference.

Requirements

• Masters degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); PhD preferred
• 6+ years (academic/ industry) experience with ML/DL systems development
• Strong experience in developing or using deep learning frameworks such as PyTorch, JAX, TensorFlow, ONNX
• Strong Python and C/C++ programming skills

Responsibilities

• Innovating and developing new AI systems technologies for efficient inference
• Designing, implementing, and optimizing kernels for high impact AI workloads
• Designing and implementing extensible abstractions for LLM serving engines
• Building efficient just-in-time domain specific compilers and runtimes
• Collaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teams
• Contributing to open source communities like FlashInfer, vLLM, and SGLang

Benefits

• Multiple relocation packages
• Two weeklong shutdowns (mid-summer and year-end) in the US (in addition to PTO)
• 8-week parental leave
• 9 Employee Resource Groups
• Annual bonus offering
• Flexible work arrangements
• Up to 6% 401K matching