JobsSenior Deep Learning Frameworks CUDA Software Engineer
NVIDIA logo

Senior Deep Learning Frameworks CUDA Software Engineer

NVIDIA

Location

remote, Santa Clara, CA, Austin, TX

Type

Full-time

Posted

5/15/2026

Compensation

$184,000 - $356,500 per year

Undergraduate with 5+ Years of Experience
Approval 99.2%·Filings 1,781·New hires 873·
👑 Elite Sponsor
·FY 2025

Job description

NVIDIA is seeking a motivated Deep Learning engineer to enhance AI stacks with advanced CUDA features and Distributed Runtime technologies. The role involves working with a team that has developed core CUDA features for scaling Deep Learning and HPC applications. The engineer will address diverse multi-GPU demands and contribute to the development of innovative technologies. This position offers an opportunity to advance the state of the art in AI applications.

Requirements

  • BS, MS, or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or related field.
  • 8+ years of relevant industry experience or equivalent academic experience after completed degree.
  • Development experience with Deep Learning Frameworks such as PyTorch, JAX, and Inference Engines like TRT-LLM, vLLM, SGLang.
  • Rapid prototyping and development experience with Python, C++, CUDA or related DSLs.
  • Solid grasp of AI models, parallelisms, and/or compiler technologies.
  • Experience conducting performance benchmarking on AI clusters.
  • Familiarity with at least one performance profiler toolchain.
  • Understanding of HPC/AI communication concepts.
  • Good understanding of computer system architecture, HW-SW interactions and operating systems principles.
  • Adaptability and passion to learn new frameworks and tools.
  • Flexibility to work and communicate effectively across different teams and timezones.

Responsibilities

  • Integrate new CUDA features and Runtime abstractions in AI frameworks from PoC to performance analysis to production.
  • Perform deep analysis of AI workloads and frameworks to identify requirements and opportunities for innovation.
  • Own and drive improvements in the AI Compiler-Runtime interface for multi-GPU multi-node solutions.
  • Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads.
  • Influence the roadmap of core CUDA to facilitate building next-gen DL frameworks.
  • Collaborate with AI researchers, HW and SW architects, kernel and compiler authors, and CUDA driver experts.
  • Develop exploratory tools and runtime systems to profile and accelerate new paradigms in deep learning.
  • Write clean, effective, and maintainable code for smooth transitions of prototypes into various releases.

Benefits

  • Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.

Is this posting expired or inaccurate?