Senior System Software Engineer - Dynamo and Triton Inference Server

Job Description

NVIDIA is seeking a Senior System Software Engineer to work on GPU-accelerated deep learning software, focusing on developing open source software for AI model inference on GPUs.

Requirements

• Masters or PhD in Computer Science, Computer Engineering, or related field
• 8+ years of experience
• Excellent Rust/Python/C++ programming and software design skills
• Experience with high scale distributed systems and ML systems

Responsibilities

• Develop open source software for inference of trained AI models on GPUs
• Build robust, scalable, high-performance software components for distributed inference workloads
• Optimize prediction throughput under latency constraints
• Integrate the latest open source technology
• Work with team leads to prioritize features and capabilities

Benefits

• Multiple relocation packages
• Two weeklong shutdowns (mid-summer and year-end) in the US (in addition to PTO)
• 8-week parental leave
• 9 Employee Resource Groups
• Annual bonus offering
• Flexible work arrangements
• Up to 6% 401K matching