The Sr. Inference Engineer role focuses on GPU Kernel Optimization within NVIDIA's LLM Inference Performance Analysis and Optimization team. This team is dedicated to enhancing GPU performance for LLM inference by developing benchmarking infrastructure and optimization systems. The position involves close collaboration with various teams to identify bottlenecks and implement performance improvements. Candidates will work on microbenchmarking, model performance analysis, and AI-driven kernel optimization.

• Master's or PhD in Computer Science, Computer Engineering, or a related field, or equivalent experience.
• 6+ years of relevant industry experience.
• Experience building or directing agentic AI systems such as code generation or automated optimization.
• Strong Python and C++ skills with proven software engineering fundamentals.
• Hands-on GPU profiling experience with CUPTI, NSYS, and NCU.
• Direct experience with LLM inference frameworks such as TRT-LLM, SGLang, or vLLM.
• Working knowledge of GPU kernel optimization including CUDA, CUTLASS, or Triton.

• Drive GPU kernel microbenchmarking to measure competing kernel implementations.
• Conduct end-to-end model performance analysis to identify optimization opportunities.
• Apply AI-driven analysis for diagnosing performance gaps and exploring optimization opportunities.
• Collaborate closely with compiler, hardware, kernel, and framework teams to deliver performance gains.
• Produce optimization policies for production inference deployments.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.