JobsSenior Software Architect, AI Systems and Networking
Senior Software Architect, AI Systems and Networking
NVIDIASenior Software Architect, AI Systems and Networking
NVIDIALocation
USA (Multiple Locations)
Type
Full-time
Posted
5/10/2026
Compensation
$184,000 - $356,500 per year
Undergraduate with 5+ Years of Experience
Approval 99.2%·Filings 1,781·New hires 873·
👑 Elite Sponsor
·FY 2025Job description
The Senior Architect role at NVIDIA involves leading the development of high-performance communication and memory management libraries for distributed AI systems. The position is part of an applied research team focused on solving complex infrastructure challenges in AI, including hardware-software co-optimization and data movement optimization. The architect will drive technical decisions and prototype new approaches while contributing to open-source projects. This role sits at the intersection of applied research and production engineering, requiring a blend of expertise and innovation.
Requirements
- 8+ years in systems software and/or networking with demonstrated ownership of complex projects.
- MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
- Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
- Strong C/C++/Rust systems programming skills with comfort in performance profiling and low-level debugging.
- Understanding of ML systems concepts such as transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.
Responsibilities
- Architect and implement high-performance communication and memory management libraries for distributed AI.
- Drive hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects.
- Profile and optimize data movement across GPU memory, system DRAM, NVMe, and network fabrics.
- Integrate networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.
- Contribute to and maintain open-source projects, mentor engineers, conduct design reviews, and prototype experimental technologies to evaluate their viability.
Benefits
- Employees at NVIDIA are often offered comprehensive, day-one benefits—including medical, dental, and vision coverage with HSA support, life and disability insurance, an Employee Assistance Program, and a 401(k) with auto-enrollment. Many roles also have generous time off and holidays, donation matching (up to $10,000), and a wide menu of extras like FSAs, commuter benefits, legal and identity-theft protection, pet insurance, and wellness discounts. Optional programs can include student-loan and home-purchase support, plus family care resources and expert medical services.
Is this posting expired or inaccurate?
