NVIDIA is seeking an architect to revolutionize the AI inference industry by addressing technical challenges related to token generation and GPU resource management. The role involves working with strategic partners to enhance performance and reliability of inference services. The architect will lead high-stakes conversations, mentor teams, and develop reference architectures for large-scale GPU clusters. This position requires a blend of technical expertise and the ability to communicate effectively with both technical and executive stakeholders.

• 6+ years in Solutions Architecture or similar roles focused on deploying distributed systems.
• At least 2 years of experience with AI workloads on Kubernetes.
• Experience with NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization.
• Deep knowledge of modern inference best practices including disaggregated serving and quantization.
• Bachelor's degree in Computer Science, Engineering, or equivalent experience.

• Work with inference partners to teach them the value of NVIDIA's stack and gather product insights.
• Build and operate inference recipes using tools like NVIDIA Dynamo to enhance efficiency.
• Accelerate inference pipelines with TensorRT-LLM and other backends for seamless integration.
• Promote devops best practices for managing Kubernetes clusters and compute fabrics.
• Provide mentorship and technical leadership to customers and internal teams on disaggregated inference systems.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.