JobsEngineering Manager, Inference Benchmarking — AI Perf
Engineering Manager, Inference Benchmarking — AI Perf
NVIDIAEngineering Manager, Inference Benchmarking — AI Perf
NVIDIALocation
remote, Santa Clara, CA, Austin, TX
Type
Full-time
Posted
5/29/2026
Compensation
$224,000 - $356,500 per year
Undergraduate with 2+ Years of Experience
Approval 99.2%·Filings 1,781·New hires 873·
👑 Elite Sponsor
·FY 2025Job description
As a Technical Lead Manager at NVIDIA, you will lead the engineering team within the Dynamo organization, focusing on advancing the AIPerf benchmarking platform for LLM serving performance. This role combines hands-on leadership with expertise in systems engineering and open-source communities. You will be responsible for ensuring the accuracy of benchmark results that inform production infrastructure decisions across the industry. Your leadership will help shape the future of AI performance measurement.
Requirements
- Bachelor's degree in Computer Science, Electrical Engineering, or related field, or equivalent experience.
- 8+ overall years of software engineering experience building performance-critical infrastructure, ML tooling, or distributed systems.
- 3+ years of engineering leadership experience as a tech lead, TLM, or engineering manager.
- Deep understanding of LLM inference mechanics and the ability to reason about measurement correctness and reproducibility.
- Proven track record of collaborating across multi-functional groups and delivering production-quality output in high-velocity environments.
Responsibilities
- Drive the technical roadmap for AIPerf's core infrastructure, including load generation and GPU telemetry.
- Take ownership for the accuracy and statistical soundness of benchmark results relied upon by engineering groups.
- Advise on upstream engine integrations in partnership with NVIDIA's Dynamo and NIM teams.
- Hire, mentor, and grow a team of senior engineers in a high-velocity open-source environment.
Benefits
- Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.
Is this posting expired or inaccurate?
