Senior AI Software Engineer, GenAI Framework

Job Description

NVIDIA NeMo is seeking AI Software Engineers to work on their open-source, scalable and cloud-native framework for Large Language Models (LLM), Multimodal (MM), and Speech AI.

Requirements

• MS, PhD or equivalent experience in Computer Science, AI, Applied Math, or related field
• 5+ years of industry experience
• Experience with AI Frameworks (e.g. PyTorch, JAX) and/or inference and deployment environments (e.g. TRT, ONNX, Triton)
• Proficient in Python programming, software design, debugging, performance analysis, test design and documentation
• Strong understanding of deep learning fundamentals and their practical application

Responsibilities

• Design and develop the GenAI open source NeMo Framework and Megatron Core
• Solve large-scale, end-to-end AI training and inference challenges
• Work at the intersection of deep learning applications, libraries, frameworks, and the entire software stack
• Performance tuning and optimizations of deep learning framework & software components
• Research, prototype and develop robust and scalable AI tools and pipelines

Benefits

• Multiple relocation packages
• Two weeklong shutdowns (mid-summer and year-end) in the US (in addition to PTO)
• 8-week parental leave
• 9 Employee Resource Groups
• Annual bonus offering
• Flexible work arrangements
• Up to 6% 401K matching