Join NVIDIA’s TensorRT Edge-LLM team to push the boundaries of real-time large language model inference. This role focuses on developing a state-of-the-art inference framework in modern C++ for edge AI applications in automotive and robotics. You will collaborate with various teams to optimize performance and contribute to cutting-edge generative AI experiences on embedded platforms. The position offers an opportunity to work with emerging techniques in the rapidly evolving LLM/VLM ecosystem.

• BS, MS, PhD, or equivalent experience in Computer Science, Electrical/Computer Engineering, or a closely related field.
• 4+ years of relevant software development experience.
• Deep understanding of transformer models and inference optimization techniques.
• Proficient programming ability with modern C++ (C++11/14/17 and beyond).
• Familiarity with popular LLM frameworks and libraries.

• Develop and evolve a state-of-the-art inference framework in modern C++ that extends TensorRT.
• Design and implement compiler and runtime optimizations for transformer-based models.
• Collaborate with teams across CUDA, kernel libraries, compilers, and robotics.
• Contribute to CUDA kernel and operator development for critical transformer components.
• Benchmark, profile, and optimize inference performance across diverse environments.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.