The Software Engineer role at Annapurna Labs focuses on optimizing collective operations for AWS Trainium, a key initiative for AI model training. The Neuron Collectives team develops software that enhances communication primitives, allowing AI training to scale across thousands of chips. This position involves close collaboration with hardware teams to maximize performance and efficiency. Candidates will have the opportunity to work on cutting-edge AI training hardware and contribute to significant advancements in the field.

• Bachelor's degree in computer science or equivalent.
• 5+ years of experience building complex software systems that have been successfully delivered to customers.
• 5+ years of experience contributing to the architecture and design of new and current systems.
• Master's degree in computer science or equivalent is preferred.
• Familiarity with collective communication algorithms or distributed training frameworks.

• Enhance collective algorithms and topologies for optimal training performance.
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization.
• Monitor and analyze processor, DMA, firmware, and workload metrics.
• Optimize collective operations to scale AI compute across the data center.
• Work closely with the hardware team to co-optimize software and Trainium silicon.
• Develop and optimize C/C++ implementations of collective communication patterns.
• Investigate and implement improvements for specific training topologies used by modern LLMs.
• Build and maintain analysis frameworks and automation solutions.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.