As a Solutions Architect focused on AI inference at NVIDIA, you will be part of a team dedicated to enhancing AI inference solutions using GPU technology and Kubernetes. Your role involves collaborating with engineering, DevOps, and customers to develop enterprise AI solutions. You will work on building and optimizing inference pipelines, ensuring efficient task distribution among GPU workers. This position emphasizes mentorship and technical leadership in deploying disaggregated inference systems.

• 5+ years in Solutions Architecture with a proven track record of deploying distributed systems and AI inference workloads on Kubernetes.
• Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving.
• Experience in GPU orchestration using NVIDIA GPU Operator, NIM Operator, and Multi-Instance GPU (MIG) partitioning.
• Ability to solve sophisticated GPU allocation, memory hierarchies, and low-latency networking.
• Demonstrated success in tuning large language models for low-latency inference in enterprise environments.
• Bachelor's degree in Computer Science, Engineering, or equivalent experience.

• Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency.
• Collaborate with DevOps teams to orchestrate disaggregated inference using Kubernetes for complex workloads.
• Accelerate inference pipelines using TensorRT-LLM, vLLM, SGLang, and other backends to ensure seamless integration.
• Provide mentorship and technical leadership to customers and internal teams, guiding them through deployment.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.