As a Neuron Collectives Software Developer at Annapurna Labs, you will enhance collective algorithms and optimize software for AI training performance. The team focuses on developing hardware and software components for AWS EC2 infrastructure, particularly for machine learning and high-performance computing workloads. You will work closely with hardware engineers and other experts to ensure maximum performance from Trainium, Amazon's AI training chip. This role offers opportunities for mentorship and career growth in a fast-paced, innovative environment.

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience with new and existing systems
• Experience programming with at least one software programming language
• 3+ years of full software development life cycle experience, including coding standards and testing
• Bachelor's degree in computer science or equivalent

• Enhance collective algorithms and topologies for optimal training performance
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
• Monitor and analyze processor, DMA, firmware, and workload metrics
• Optimize collective operations to scale AI compute across the data center
• Work closely with the hardware team to co-optimize software and Trainium silicon
• Develop and optimize C/C++ implementations of collective communication patterns
• Investigate and implement improvements for specific training topologies used by modern LLMs
• Build and maintain analysis frameworks and automation solutions

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.