Job Description

NVIDIA is seeking a Senior Deep Learning Software Engineer to analyze and improve the performance of LLM inference. The role involves collaborating with various teams to optimize deep learning models and contribute to NVIDIA's software frameworks for deployment and serving of these models.

Requirements

Bachelors, Masters, PhD, or equivalent experience in relevant fields (Computer Engineering, Computer Science, EECS, AI)
At least 8 years of relevant software development experience
Excellent Python/C/C++ programming, software design and software engineering skills
Experience with a DL framework like PyTorch, JAX, TensorFlow

Responsibilities

Performance optimization, analysis, and tuning of LLM, VLM and GenAI models for DL inference, serving and deployment in NVIDIA/OSS LLM frameworks
Scale performance of LLM models across different architectures and types of NVIDIA accelerators
Scale performance for max throughput, minimum latency and throughput under latency constraints
Contribute features and code to NVIDIA/OSS LLM frameworks, inference benchmarking frameworks, TensorRT, and Triton
Work with cross-collaborative teams across generative AI, automotive, image understanding, and speech understanding to develop innovative solutions

Benefits

Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.