We are looking for highly skilled software engineers to develop AI inference systems that optimize large-scale models. The role involves architecting high-performance inference stacks and collaborating with various teams to enhance accelerated computing for AI. Candidates will work on optimizing GPU kernels and contribute to industry benchmarks. This position offers the opportunity to conduct original research and integrate innovative ideas into NVIDIA's software products.

• Bachelor's degree in Computer Science, Computer Engineering, or Software Engineering with 7+ years of experience, or a Master's degree with 5+ years of experience, or a PhD with relevant publications.
• Strong programming skills in Python and C/C++, with experience in Go or Rust as a plus.
• Solid understanding of algorithms, data structures, operating systems, computer architecture, parallel programming, and distributed systems.
• Knowledge and passion for performance engineering in ML frameworks and inference engines.
• Familiarity with GPU programming, CUDA, and profiling/debug tools.

• Contribute features to vLLM that utilize the latest NVIDIA GPU hardware features.
• Develop, optimize, and benchmark GPU kernels using techniques such as fusion and autotuning.
• Define and build inference benchmarking methodologies and contribute to the MLPerf Inference benchmarking suite.
• Architect the scheduling and orchestration of large-scale inference deployments on GPU clusters.
• Conduct and publish original research to advance the field of ML Systems.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.