Senior System Software Engineer - Dynamo and Triton Inference Server

Job Description

NVIDIA is seeking a Senior System Software Engineer to work on Dynamo & Triton Inference Server, focusing on GPU-accelerated deep learning software development.

Requirements

• Masters or PhD or equivalent experience
• 8+ years in Computer Science, Computer Engineering, or related field
• Ability to work in a fast-paced, agile team environment
• Excellent Rust/Python / C++ programming and software design skills, including debugging, performance analysis, and test design
• Experience with high scale distributed systems and ML systems

Responsibilities

• Develop open source software for inference of trained AI models running on GPUs
• Build robust, scalable, high-performance software components to support distributed inference workloads
• Optimize prediction throughput under latency constraints
• Integrate the latest open source technology
• Collaborate with team leads to prioritize features and capabilities

Benefits

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.