The role is focused on enhancing the performance of NVIDIA's CUTLASS team, which is dedicated to high-performance linear algebra and Tensor Core primitives. The team aims to bridge the gap between current performance and theoretical possibilities in deep learning computations. The position involves benchmarking deep learning models and developing tools for performance optimization. Candidates will collaborate with various teams across NVIDIA to represent performance interests.

• Masters or PhD degree in Computer Science, Computer Engineering, or related field or equivalent experience.
• 3+ years of relevant industry experience.
• Strong programming skills in Python and C++.
• Experience in software performance analysis and optimization.
• Deep understanding of computer architecture and familiarity with GPUs or similar parallel processing architectures.

• Benchmark the performance of state-of-the-art deep learning models’ inference and training passes to identify key GPU kernel and fusion opportunities.
• Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them.
• Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks.
• Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.