The role focuses on optimizing distributed training performance on AWS Trainium, specifically enhancing training throughput across the Neuron software stack. The team works at the intersection of machine learning, high-performance computing, and distributed systems, contributing to the development of infrastructure for large-scale training. Engineers will collaborate with compiler, runtime, and collectives teams to address performance gaps and influence future architecture designs. This position offers a unique opportunity to shape AI acceleration technology while ensuring efficient model training for customers.

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience of new and existing systems
• Experience programming with at least one software programming language
• 3+ years of full software development life cycle experience, including coding standards and operations
• Bachelor's degree in computer science or equivalent

• Lead the effort to optimize distributed training performance on Trainium.
• Work across the PyTorch and Neuron software stack to enable large-scale training workloads.
• Own the parallelism strategies that models depend on, including data, tensor, and pipeline parallelism.
• Profile workloads to determine performance bottlenecks and drive fixes to the appropriate layer.
• Translate performance gaps into requirements that influence frameworks and contribute to open source projects.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.