JobsSenior System Software Engineer - Dynamo-Triton Inference Server
NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Location

remote, Santa Clara, CA, Seattle, WA

Type

Full-time

Posted

7/3/2026

Compensation

$152,000 - $287,500 per year

Master's with 5+ Years of Experience
PhD with 5+ Years of Experience
Approval 99.2%·Filings 1,781·New hires 873·
👑 Elite Sponsor
·FY 2025

Job description

The Senior System Software Engineer will work on the Dynamo-Triton Inference Server at NVIDIA, contributing to the development of GPU-accelerated AI inference serving software. This role is part of a fast-paced team focused on building a high-performance AI inference platform that simplifies the design and deployment of AI models. The engineer will engage with the open-source deep learning community and balance various objectives, including optimizing software for production environments. The position requires strong programming skills and experience in deep learning software.

Requirements

  • MS or PhD in Computer Science or a relevant field or equivalent experience.
  • 5+ years of professional experience working on deep learning software.
  • Excellent skills in Rust and C++, familiarity with Python, and strong programming and software design skills.
  • Experience with high-scale distributed systems and machine learning systems.
  • Strong communication skills and the ability to work in a fast-paced, agile team environment.

Responsibilities

  • Develop world-class GPU-accelerated AI inference serving software.
  • Contribute to feature development and drive broad customer adoption.
  • Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified inference platform.
  • Balance objectives such as building robust software for production environments and optimizing prediction throughput and latency.
  • Develop and adopt the next generation of inference technologies.

Benefits

  • Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.

Is this posting expired or inaccurate?