The Senior Software Engineer will join the ML Distributed Training team at Annapurna Labs, focusing on the development and optimization of large scale machine learning model training. This role involves working with diverse model families, including LLMs and multimodal models, while collaborating with various engineering teams to deliver efficient solutions on AWS Trainium systems. The position emphasizes precision optimization and performance tuning of training pipelines. The team is part of AWS, which integrates silicon and software to tackle technical challenges.

• Bachelor's degree in computer science or equivalent.
• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years of experience leading design or architecture of new and existing systems.
• 5+ years of experience in the full software development life cycle.
• Experience as a mentor or tech lead.
• Experience in machine learning and large scale training with LLMs.
• Expertise in Pytorch.
• Master's degree in computer science or equivalent is preferred.
• Experience in computer architecture.
• Previous software engineering expertise with Pytorch/Jax/Tensorflow and distributed libraries.

• Design, implement, and optimize distributed training solutions for large scale ML models on Trainium instances.
• Extend and optimize popular distributed training frameworks for the Neuron ecosystem.
• Develop and optimize mixed-precision and low-precision training techniques.
• Implement precision aware training strategies and loss scaling techniques.
• Profile, analyze, and tune end-to-end training pipelines for optimal performance.
• Collaborate with hardware, compiler, and runtime teams to influence system design.
• Work directly with AWS solution architects and customers to deploy and optimize training workloads.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.