The Senior Deep Learning Software Engineer will design and build automated inference and deployment solutions, focusing on scalable architecture and compute efficiency. This role involves working with high-level frameworks like PyTorch and JAX, as well as low-level GPU optimizations and custom GPU kernels. The engineer will collaborate with various teams at NVIDIA to enhance the performance of inference software solutions. This position is ideal for those with a strong background in machine learning and software engineering.

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or a related field.
• 8+ years of relevant work or research experience in Deep Learning.
• Excellent software design skills, including debugging, performance analysis, and test design.
• Strong proficiency in Python, PyTorch, and related ML tools.
• Strong algorithms and programming fundamentals.
• Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment.

• Define a modular, scalable platform to bridge training and deployment workflows.
• Leverage the torch 2.0 ecosystem to analyze and extract standardized model graph representations.
• Develop support for inference optimization techniques such as speculative decoding and LoRA.
• Collaborate with teams across NVIDIA to implement performant kernel solutions.
• Analyze and profile GPU kernel-level performance for optimization opportunities.
• Continuously innovate on inference performance to maintain leadership in the market.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.