We are looking for an experienced engineer to develop distributed AI/ML systems, focusing on collective operations that enhance scalability across multiple servers and accelerators. The role is part of Annapurna Labs, a key component of AWS, which specializes in hardware and software for EC2 infrastructure. You will collaborate with a diverse team of experts and have opportunities for mentorship and career growth. This position emphasizes solving complex problems in the fast-evolving AI/ML landscape.

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience with at least one software programming language
• 5+ years of experience leading design or architecture of new and existing systems
• 5+ years of experience in the full software development life cycle, including coding standards and testing
• Experience as a mentor or tech lead for an engineering team
• Must have C/C++ coding experience
• Bachelor's degree in computer science or equivalent
• Experience with ML communications such as NCCL, NIXL, NVSHMEM

• Work on collective operations that enable AI to scale across multiple accelerators and servers.
• Develop and optimize low-level C/C++ code for distributed AI/ML systems.
• Collaborate with infrastructure experts, hardware engineers, and scientists.
• Mentor junior engineers and contribute to their professional development.
• Iterate quickly to deliver meaningful solutions for HPC and ML workloads.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.