NVIDIA is seeking a deeply technical software manager to lead the production AI inference for NVIDIA Inference Microservices (NIM). This hands-on engineering management role focuses on delivering production-ready AI models and optimizing workflows across various environments. The manager will work closely with engineers and internal teams to ensure reliable releases and continuous improvement in production processes. The ideal candidate will have a strong background in AI/ML fundamentals and experience in managing software engineering teams.

• 10+ years of experience building production software, including 3+ years managing software engineering teams.
• Experience delivering production software with strong quality, reliability, and release expectations.
• Experience driving process improvements and improving operational efficiency.
• Excellent communication and collaborator management skills.
• Deep understanding of AI/ML fundamentals, innovative model architectures, and performance optimization strategies.
• A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience.

• Lead the team responsible for shipping production-ready LLM NIMs, including planning and new model onboarding.
• Build a predictable operating model for the team through roadmap planning and clear ownership boundaries.
• Own project execution by anticipating schedule, staffing, and dependency risks.
• Drive continuous improvement in production workflows through feedback and removing unnecessary work.
• Build and maintain a world-class AI inference engineering team by fostering an innovative culture and mentoring engineers.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.