The Senior System Software Engineer will work on the Dynamo-Triton Inference Server at NVIDIA, contributing to the development of GPU-accelerated AI inference serving software. This role is part of a fast-paced team focused on creating a high-performance inference platform that simplifies the design and deployment of AI models. The engineer will engage with the open source deep learning community and balance various objectives, including software robustness and optimization for production environments. The position requires strong programming skills and a commitment to driving customer adoption of new features.

• MS or PhD in Computer Science or relevant field or equivalent experience.
• 12+ years of professional experience working on deep learning software.
• Excellent Rust and C++ skills, familiarity with Python, and strong programming and software design skills.
• Experience with high-scale distributed systems and ML systems.
• Strong communication skills and ability to work in a fast-paced, agile team environment.

• Develop world-class GPU-accelerated AI inference serving software.
• Contribute to feature development and drive broad customer adoption.
• Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified, high-performance inference platform.
• Balance a variety of objectives such as building robust software designed for production server or cloud environments.
• Optimize and balance prediction throughput and latency while developing next generation inference technologies.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.