JobsDistinguished Engineer, Scaled Out Inferencing
NVIDIA logo

Distinguished Engineer, Scaled Out Inferencing

NVIDIA

Location

remote, Santa Clara, CA

Type

Full-time

Posted

8/18/2026

Compensation

$320,000 - $488,750 per year

PhD with 5+ Years of Experience
H-1B FY202699.2% approval-37% YoY
đź‘‘ Elite sponsor

Job description

NVIDIA is seeking a technology leader to develop a global strategy for scaled-out AI inferencing. The role involves architecting high-throughput, low-latency distributed pipelines and model serving strategies for massive scale and production reliability. You will work closely with NVIDIA leadership to establish systems that enable advanced AI models to run efficiently on accelerated computing hardware. This position requires a strong focus on collaboration, technical leadership, and innovation in AI infrastructure.

Requirements

  • 16+ years in technical roles with a focus on AI infrastructure and large-scale inference orchestration.
  • 7-10+ years of leadership experience.
  • BS/MS or higher in systems/software engineering or related fields.
  • Proficiency in GPU architecture, hardware acceleration, and low-level performance tuning.
  • Proven success in delivering complex solutions with transparency into resource utilization and performance.

Responsibilities

  • Architect distributed pipelines for high-throughput, low-latency inference systems.
  • Collaborate on hardware-software co-optimization and performance tuning.
  • Guide and influence open source projects to enhance inferencing on NVIDIA hardware.
  • Orchestrate model lifecycles and lead full-lifecycle model management strategies.
  • Engage with stakeholders to ensure NVIDIA's solutions set industry standards.

Benefits

  • Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.

H-1B filing history

Public USCIS petition and DOL LCA counts · latest USCIS FY2026, LCA FY2026

Filing entity: Nvidia Corporation

As of Aug 23, 2026

Initial approvals

355

FY2026

Approval rate

99.2%

FY2026

LCA certified

7,667

FY2026

Entry-level share

11.9%

FY2026

Initial approvals YoY

-37%

Trend

LCA certified YoY

-83%

Trend

Initial approvals by fiscal year

Approval rate by fiscal year

Continuing vs initial approvals

LCA certified positions by quarter

LCA certified positions by fiscal year

Based on public USCIS and DOL filings; not a sponsorship guarantee.

Is this posting expired or inaccurate?