Senior System Software Engineer - Triton Inference Server

Job Description

NVIDIA is seeking a Senior System Software Engineer to work on Triton Inference Server, focusing on developing open source software for inference of trained AI models running on GPUs.

Requirements

• Masters or PhD in Computer Science, Computer Engineering, or related field
• 6+ years of experience in software engineering
• Excellent Python / C++ programming and software design skills
• Experience with high scale distributed systems and ML systems

Responsibilities

• Developing open source software to serve inference of trained AI models running on GPUs
• Building robust, scalable, high-performance software components to support distributed inference workloads
• Working with team leads to prioritize features and capabilities
• Optimizing prediction throughput under latency constraints

Benefits

• Multiple relocation packages
• Two weeklong shutdowns (mid-summer and year-end) in the US (in addition to PTO)
• 8-week parental leave
• 9 Employee Resource Groups
• Annual bonus offering
• Flexible work arrangements
• Up to 6% 401K matching