The Senior Software Engineer for Deep Learning Inference will play a crucial role in developing a state-of-the-art inference framework aimed at accelerating Deep Learning models, particularly Large Language Models, on NVIDIA GPUs. This position is part of the TensorRT software team, which focuses on high-performance deep learning inference. The engineer will work closely with deep learning experts and GPU architects to create robust inferencing software that can be deployed across multiple platforms. Candidates should be passionate about making a significant impact in the field of artificial intelligence.

• A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field.
• 3+ years of software development experience.
• Strong experience with the latest C++ standards such as C++11/C++14/C++17/C++20.
• Strong grasp of Machine Learning concepts.
• Experience and knowledge in Computer Architecture, Data Structures, and Algorithms.
• Excellent communication skills, and an aptitude for collaboration and teamwork.

• Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance.
• Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference.
• Closely follow academic developments in the field of artificial intelligence and feature update TensorRT.
• Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models.
• Collaborate with teams of deep learning experts, GPU architects, and DevOps engineers across diverse teams.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.