The Senior System Software Engineer will join NVIDIA's GPU-accelerated deep learning software team, focusing on developing open source software for AI model inference on GPUs. The team is dedicated to building a Generative AI inference platform that simplifies the design and deployment of AI models. This role involves innovating in inference-state management and enhancing distributed inference capabilities. Candidates should be prepared to work in a fast-paced environment and contribute to cutting-edge AI technologies.

• Masters or PhD or equivalent experience
• 10+ years in Computer Science, Computer Engineering, or related field
• Excellent Rust/Python programming and software design skills
• Understanding of modern LLM API semantics

• Develop open source software to serve inference of trained AI models running on GPUs.
• Contribute to the development of disaggregated serving for Dynamo-supported inference engines.
• Innovate in inference-state management for long-running agents.
• Build and evolve Dynamo’s distributed inference frontend across various frameworks.
• Balance objectives to build robust, scalable, high-performance software components.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.