NVIDIA is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The role focuses on optimizing and serving performant inferencing for AI models in heterogeneous cluster environments. The engineer will leverage deep technical expertise to create a scalable and reliable automation factory infrastructure. Collaboration with multiple AI model teams and driving technical advances in workflows are key aspects of this position.

• A BS or MS in Computer Science, Computer Engineering or related field, or equivalent experience.
• 8+ years of experience developing performant microservices, cloud software, and/or tooling roles.
• Deep technical expertise in distributed containerized applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
• Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.
• Effective experience working with multi-functional teams, principals, and architects across organizational boundaries.

• Develop a factory pipeline that takes an AI model and produces a deployable service validated across Cloud, On-prem, and Kubernetes environments.
• Define and deliver rapid iterations on the group's technical strategies and roadmaps to improve the NIM factory.
• Design interfaces, data modeling, and schema design while expanding observability over the factory pipeline and its compute infrastructure.
• Collaborate with multiple AI model teams to understand their requirements and build an efficient infrastructure.
• Define metrics and drive improvements based on user feedback while mentoring and collaborating with team members.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.