NVIDIA is seeking a Senior Software Engineer specializing in Deep Learning Inference to join their team. The role involves designing, building, and optimizing GPU-accelerated software for advanced AI applications. The engineer will focus on improving open-source frameworks for large-scale model serving and inference, working closely with the deep learning community. This position requires collaboration across various teams to implement the latest algorithms and enhance performance across NVIDIA accelerators.

• Masters or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, or AI.
• 5+ years of relevant software development experience.
• Excellent C/C++ programming and software design skills.
• Experience with training, deploying, or optimizing the inference of deep learning models in production is a plus.
• Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.
• GPU programming experience (CUDA, OAI TRITON or CUTLASS) is a plus.

• Perform optimization, analysis, and tuning of deep learning models in various domains like LLM, Multimodal, and Generative AI.
• Scale performance of deep learning models across different architectures and types of NVIDIA accelerators.
• Contribute features and code to NVIDIA’s inference libraries, including vLLM and SGLang.
• Collaborate with cross-functional teams to develop innovative inference optimization solutions.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.