NVIDIA is seeking a Senior Software Engineer to lead the optimization and benchmarking of distributed training and inference workloads on GPU platforms. This role involves setting technical direction across communication libraries and model frameworks to ensure efficient operation of large language model workloads. The engineer will conduct deep performance investigations and build resilience capabilities for large clusters. This position is hands-on and requires expertise in deep learning systems and distributed computing.

• Bachelor's or Master's in Computer Science or a related technical field or equivalent experience.
• 8+ years of experience developing software infrastructure for large-scale AI or HPC systems.
• Expertise debugging and triaging AI applications across the full stack.
• Deep hands-on experience with NCCL, CUDA-aware distributed execution, and debugging multi-GPU and multi-node workloads at scale.
• Proven track record of architecting, debugging, and scaling large-scale distributed systems.
• Expert-level Python and C/C++ programming skills.
• Experience operating workloads in scheduled, containerized cluster environments.
• Excellent analytical, debugging, and communication skills.

• Lead bring-up, validation, and debugging of large-scale AI clusters and workloads.
• Tune and benchmark AI pre-training, post-training, and inference workloads using NVIDIA AI software stacks.
• Profile and optimize end-to-end workload performance across various layers.
• Analyze scaling efficiency for distributed LLM workloads and provide tuning guidance.
• Conduct root-cause analysis of complex failures in large distributed environments.
• Define and build the resilience and failure-attribution stack for the cluster.
• Build repeatable benchmark suites and qualification workflows on new platforms.
• Tune runtime settings and deployment configurations in partnership with other teams.
• Deliver actionable recommendations based on profiling and benchmark results.
• Mentor engineers and drive technical standards within the organization.

• Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.