NVIDIA is seeking a highly skilled Engineering Manager to lead the development of next-generation LLM/VLM/VLA inference software technologies. This role combines deep technical expertise with world-class management, focusing on enhancing the performance of LLM inference across various frameworks. The position involves collaboration with researchers and architects to deliver high-quality software that sets industry standards. The ideal candidate will manage and grow a team of engineers dedicated to pushing the boundaries of AI performance.

• MS, PhD, or equivalent experience in Computer Science, Computer Engineering, AI, or a related technical field.
• 7+ years of overall software engineering experience, including 3+ years of technical leadership experience.
• Proven ability to lead and scale high-performing engineering teams across distributed and cross-functional groups.
• Strong background in C++ or Python with expertise in software design and delivering production-quality software libraries.
• Demonstrated expertise in large language models (LLM) and/or vision language models (VLM) and/or inference.

• Lead and grow a team responsible for enhancing the performance of LLM inference across multiple frameworks.
• Drive the design, implementation, and optimization of key features for LLM inference performance.
• Continuously improve LLM inference performance on current and upcoming NVIDIA datacenter architectures and GPUs.
• Work with inference benchmark teams to tune performance for key workloads.
• Integrate cutting-edge technologies developed at NVIDIA to provide an intuitive developer experience for LLM deployment.
• Lead software development execution, including project planning, milestone delivery, and cross-functional coordination.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.