JobsDistinguished Engineer, Scaled Out Inferencing
NVIDIA logo

Distinguished Engineer, Scaled Out Inferencing

NVIDIA

Location

remote, Santa Clara, CA

Type

Full-time

Posted

8/18/2026

Compensation

$320,000 - $488,750 per year

PhD with 5+ Years of Experience
Approval 99.2%·Filings 1,781·New hires 873·
👑 Elite Sponsor
·FY 2025

Job description

NVIDIA is seeking a technology leader to develop a global strategy for scaled-out AI inferencing. The role involves architecting high-throughput, low-latency distributed pipelines and model serving strategies for massive scale and production reliability. You will work closely with NVIDIA leadership to establish systems that enable advanced AI models to run efficiently on accelerated computing hardware. This position requires a strong focus on collaboration, technical leadership, and innovation in AI infrastructure.

Requirements

  • 16+ years in technical roles with a focus on AI infrastructure and large-scale inference orchestration.
  • 7-10+ years of leadership experience.
  • BS/MS or higher in systems/software engineering or related fields.
  • Proficiency in GPU architecture, hardware acceleration, and low-level performance tuning.
  • Proven success in delivering complex solutions with transparency into resource utilization and performance.

Responsibilities

  • Architect distributed pipelines for high-throughput, low-latency inference systems.
  • Collaborate on hardware-software co-optimization and performance tuning.
  • Guide and influence open source projects to enhance inferencing on NVIDIA hardware.
  • Orchestrate model lifecycles and lead full-lifecycle model management strategies.
  • Engage with stakeholders to ensure NVIDIA's solutions set industry standards.

Benefits

  • Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.

Is this posting expired or inaccurate?