NVIDIA is seeking a Senior Software Engineer with a focus on Deep Learning Inference to join their team. The role involves designing, building, and optimizing GPU-accelerated software for advanced AI applications. The engineer will work on high-performance deep learning frameworks like SGLang and vLLM, contributing to the deployment and serving of innovative language models. Collaboration with the deep learning community to implement the latest algorithms is a key aspect of this position.

• Masters or PhD or equivalent experience in a relevant field such as Computer Engineering, Computer Science, EECS, or AI.
• 6+ years of relevant software development experience.
• Excellent C/C++ programming and software design skills.
• Experience with training, deploying, or optimizing the inference of deep learning models in production is a plus.
• Prior background with performance modeling, profiling, debugging, and code optimization or architectural knowledge of CPU and GPU is a plus.

• Perform optimization, analysis, and tuning of deep learning models in various domains like LLM, Multimodal, and Generative AI.
• Scale performance of deep learning models across different architectures and types of NVIDIA accelerators.
• Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer, and LLM software solutions.
• Collaborate with cross-functional teams across frameworks, NVIDIA libraries, and inference optimization solutions.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.