Senior AI System Engineer

Job Description

NVIDIA is seeking an AI/ML System Performance Engineer to contribute to the development of next-generation inference optimizations and deliver industry-leading performance.

Requirements

• Master's degree in Computer Science, Electrical Engineering or related fields.
• 3+ years of hands-on experience in system evaluation of AI/ML workloads or performance analysis, modeling and optimizations for AI
• Strong background in computer architecture, roofline modeling, queuing theory and statistical performance analysis techniques.
• Proficiency in Python (and optionally C++) for simulator design and data analysis.
• Experience with GPU computing (CUDA)
• Experience with deep learning frameworks like PyTorch, TRT-LLM, VLLM, SGLang
• Growth mindset and pragmatic approach.

Responsibilities

• Optimize inference deployment by pushing the Pareto frontier of Accuracy, Throughput and Interactivity at datacenter scale
• Develop high-fidelity performance models to prototype emerging algorithmic techniques & hardware optimizations
• Prioritize features to guide future software and hardware roadmap based on detailed performance modeling and analysis
• Model end-to-end performance impact of emerging GenAI workflows
• Keep up with the latest DL research and collaborate with diverse teams.

Benefits

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.