NVIDIA is seeking a Senior Inference Performance Engineer to enhance performance on large-scale AI inference benchmarks. This role involves optimizing AI workloads and collaborating with various teams to improve GPU performance. The engineer will utilize an autonomous optimization framework to maximize throughput and user interactivity. Candidates should have a strong background in AI model execution and performance profiling.

• BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Math, or a related field, or equivalent experience.
• 3+ years of relevant engineering experience.
• Extensive knowledge of efficiency and optimization in AI model execution, including continuous batching and throughput-latency tradeoffs.
• Hands-on experience benchmarking and profiling GPU workloads using tools such as Nsight Systems and interpreting kernel-level performance data.
• Strong Python engineering skills and the ability to navigate and modify large C++/CUDA serving codebases.
• Rigorous experimental methodology with controlled single-variable comparisons and reproducible benchmarks.
• Strong written and verbal communication skills.

• Distill performance instincts into reusable skills and methodologies for AI agents.
• Review agent-generated experiments and validate findings.
• Improve AI inference workloads to increase throughput-per-GPU and user interactivity.
• Measure and optimize serving architectures across various platforms.
• Profile workloads using Nsight Systems and other internal analysis tools.
• Land improvements upstream by contributing to serving framework patches and optimized kernels.
• Collaborate with various teams to convert profiling insights into performance improvements.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.