NVIDIA is seeking a Senior Deep Learning Software Engineer to join the Algorithmic Model Optimization Team, which focuses on enhancing the efficiency of generative AI models. The role involves developing and scaling automated inference and deployment solutions, utilizing high-level frameworks like PyTorch and HuggingFace. The engineer will work on optimizing model performance and collaborating with various teams to implement high-performance kernel solutions. This position is ideal for individuals with a strong background in machine learning and software engineering.

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or a related field.
• 8+ years of relevant work or research experience in Deep Learning.
• Excellent software design skills, including debugging, performance analysis, and test design.
• Strong proficiency in Python, PyTorch, and related ML tools such as HuggingFace.
• Strong algorithms and programming fundamentals.
• Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment.

• Train, develop, and deploy state-of-the-art generative AI models like LLMs and diffusion models using NVIDIA's AI software stack.
• Leverage and build upon the torch 2.0 ecosystem to analyze and extract standardized model graph representation for automated deployment.
• Develop high-performance optimization techniques for inference, including automated model sharding techniques and efficient attention kernels.
• Collaborate with teams across NVIDIA to utilize performant kernel implementations within the automated deployment solution.
• Analyze and profile GPU kernel-level performance to identify optimization opportunities.
• Continuously innovate on inference performance to maintain and increase NVIDIA's leadership in the market.
• Architect and design a modular and scalable software platform to enhance user experience and model support.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.