The Senior Research Engineer role at NVIDIA focuses on advancing generative AI inference technologies. The team is dedicated to optimizing inferencing processes to support the growing needs of generative AI applications. This position involves collaboration with research teams, engineers, and the open-source community to enhance AI integration into products and services. The ideal candidate will have a strong background in deep learning frameworks and a passion for empirical research.

• Bachelor's or Master's degree in Computer Science or equivalent experience.
• 8+ years of industry experience in Deep Learning frameworks such as PyTorch or TensorFlow.
• Experience designing or running LLM evaluations or benchmarks, ideally agentic ones.
• Understanding of modern techniques in Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition.
• Strong communication and interpersonal skills, with the ability to work in a dynamic and distributed team.
• Strong computer science fundamentals including algorithms and data structures, computational complexity, and parallel computing.

• Design and evaluate routing policies for LLM traffic to optimize model system usage.
• Build and run agentic benchmarks to measure algorithm quality and create calibration data.
• Contribute to an open-source repository by providing design documents, code reviews, and community contributions.
• Collaborate with engineering teams across NVIDIA to ensure seamless software integration.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.