Annapurna Labs, part of AWS, is seeking a Software Engineer for the AWS Neuron Collectives team to optimize collective operations for AWS Trainium, a key initiative for AI model training. The role focuses on enhancing collective algorithms and working closely with hardware teams to maximize performance using C/C++. This position offers the opportunity to impact AI training at AWS scale while developing technical skills in a collaborative environment. The team values inclusion, work-life balance, and career growth.

• Bachelor's degree in computer science or equivalent.
• Experience building complex software systems that have been successfully delivered to customers.
• Experience contributing to the architecture and design of new and current systems.
• Experience in development in the last 3 years, or experience in embedded development in C/C++.
• Familiarity with collective communication algorithms or distributed training frameworks.

• Enhance collective algorithms and topologies for optimal training performance.
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization.
• Monitor and analyze processor, DMA, firmware, and workload metrics.
• Optimize collective operations to scale AI compute across the data center.
• Work closely with the hardware team to co-optimize software and Trainium silicon.
• Develop and optimize C/C++ implementations of collective communication patterns.
• Investigate and implement improvements for specific training topologies used by modern LLMs.
• Build and maintain analysis frameworks and automation solutions.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.