Sr. Software Engineer, EC2 Instance Networking

Job Description

Join our team building the scale-out networking backbone that powers the world's largest AI training clusters. Senior engineer role focusing on developing high-performance RDMA and RoCE solutions for distributed training of trillion-parameter models across thousands of compute nodes on AWS infrastructure.

Requirements

• 5+ years of non-internship professional software development experience
• Experience leading design or architecture of new and existing systems
• Experience in C/C++ programming with focus on high-performance distributed systems
• Deep expertise in RDMA technologies, RoCE implementations, and high-performance networking
• Experience with collective communication libraries and large-scale networked systems
• Experience as a technical lead on complex infrastructure projects

Responsibilities

• Lead design and development of high-performance networking software solutions for large-scale AI clusters
• Architect SmartNIC integration strategies with EC2 control plane systems
• Drive optimization of collective communication patterns and networking protocols for distributed AI training
• Develop performance monitoring, metrics collection, and benchmarking infrastructure
• Design automated testing frameworks and stress testing methodologies
• Lead system-level debugging efforts across hardware acceleration, kernel networking, and distributed applications
• Define technical architecture and strategy for scale-out AI cluster networking
• Provide technical leadership and mentoring to engineering teams
• Drive cross-functional collaboration with hardware, cloud infrastructure, and AI platform teams
• Lead technical design reviews and establish engineering best practices

Benefits

• Medical, dental, and vision coverage (multiple plan options)
• Health savings and flexible spending accounts
• 24/7 Employee Assistance Program for mental health support
• 401(k) with company match and various investment choices
• Company-paid life/AD&D and disability insurance
• Restricted stock units (RSUs) for employee ownership
• Child care and elder care referrals, adoption assistance
• Paid maternity and parental leave (including Ramp Back)
• Paid time off (PTO) and company holidays
• Employee discount on Amazon.com products
• Career Choice program (95% tuition and textbook coverage)