Senior ML Evaluation Engineer - Autonomous Vehicles
NVIDIA Georgia, GA Full-time 3/31/2026
PhD Entry-LevelMaster's with 2+ Years of Experience
Approval 99.2%•Total filings 1,781•New hires 873•
👑 Elite Sponsor
•FY 2025Job Description
NVIDIA is seeking a candidate for their AV Eval team to develop learned evaluation systems for autonomous vehicles using LLMs and VLMs. The role involves building evaluation pipelines, defining methodologies, and transitioning from rule-based to learned evaluation, directly impacting vehicle safety and software release decisions.
Requirements
- PhD with 4+ years, MS with 6+ years, or BS with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
- Hands-on experience building LLM/VLM-based pipelines — fine-tuning, prompt engineering, retrieval-augmented generation, chain-of-thought.
- Track record of shipping ML systems to production.
- Strong software engineering fundamentals — you write clean, tested, reviewable code in Python and C++.
- Experience with evaluation methodology: precision/recall, inter-rater reliability, calibration, annotation pipelines.
- Comfort with large-scale data processing (Spark, Dask, or similar).
- Strong Python skills. Experience with PyTorch or JAX. Comfortable with GPU-based training workflows.
Responsibilities
- Design and build learned evaluation pipelines that assess driving behavior using LLMs, VLMs, and multimodal models.
- Develop agentic workflows that chain model inference, retrieval, and structured reasoning to evaluate complex driving scenarios.
- Define evaluation-of-evaluation methodology — how do we know our learned evaluators are correct?
- Build golden-set frameworks and calibration loops for learned metrics.
- Partner with AML teams on model-specific eval needs.
- Instrument evaluation systems with robust experiment tracking, A/B comparison tooling, and model versioning.
- Contribute to the team's transition from rule-based to learned evaluation.
Benefits
- Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.
Is this job posting expired or no longer available?