JobsSenior System Software Engineer - Dynamo-Triton Inference Server
NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Location

USA (Multiple Locations)

Type

Full-time

Posted

5/10/2026

Compensation

$152,000 - $287,500 per year

Undergraduate with 5+ Years of Experience
Approval 99.2%·Filings 1,781·New hires 873·
👑 Elite Sponsor
·FY 2025

Job description

NVIDIA is seeking a Senior System Software Engineer to join its GPU-accelerated deep learning software team, focusing on the Dynamo-Triton Inference Server. The role involves developing high-performance AI inference serving software and contributing to feature development for broad customer adoption. The engineer will work on unifying the Triton Inference Server and NVIDIA Dynamo stacks to support both Large Language Model and non-LLM workloads. This position requires collaboration within the open source deep learning community and balancing various software development objectives.

Requirements

  • MS or PhD in Computer Science or a relevant field or equivalent experience.
  • 5+ years of professional experience working on deep learning software.
  • Excellent skills in Rust and C++, familiarity with Python, and strong programming and software design skills.
  • Experience with high-scale distributed systems and machine learning systems.
  • Strong communication skills and the ability to work in a fast-paced, agile team environment.

Responsibilities

  • Develop world-class GPU-accelerated AI inference serving software.
  • Contribute to feature development and drive broad customer adoption.
  • Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks.
  • Build robust software designed for production server or cloud environments.
  • Optimize and balance prediction throughput and latency.

Benefits

  • Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.

Is this posting expired or inaccurate?