NVIDIA is looking for a Manager of Deep Learning Inference Software to lead a high-performing engineering team focused on AI model deployment. The team develops and optimizes open-source frameworks for scalable and efficient AI deployment on NVIDIA GPUs. This role involves guiding the strategy and execution of inference frameworks while fostering a culture of technical excellence and collaboration. The ideal candidate will have a strong background in deep learning and GPU programming.

• MS, PhD, or equivalent experience in Computer Science, Electrical/Computer Engineering, or a related field.
• 6+ years of software development experience, including 3+ years in technical leadership or engineering management.
• Strong background in C/C++ software design and development; proficiency in Python is a plus.
• Hands-on experience with GPU programming (CUDA, Triton, CUTLASS) and performance optimization.
• Proven record of deploying or optimizing deep learning models in production environments.
• Experience leading teams using Agile or collaborative software development practices.

• Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software.
• Guide the strategy, roadmap, and execution of NVIDIA's OSS inference frameworks engineering.
• Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized inference pipelines across NVIDIA accelerators.
• Oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications.
• Guide engineers in adopting best practices for CUDA, Triton, CUTLASS, and multi-GPU communications.
• Represent the team in roadmap and planning discussions, ensuring alignment with NVIDIA’s broader AI and software strategies.
• Foster a culture of technical excellence, open collaboration, and continuous innovation.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.