The role involves working as a software engineer on the Distributed Training team at Amazon Web Services, focusing on building and fine-tuning distributed training solutions for deep learning and reinforcement learning workloads. The team is dedicated to optimizing performance on AWS's custom ML accelerators, specifically Trainium. Engineers will collaborate across frameworks and components, contributing to both current performance improvements and future architecture designs. This position offers a unique opportunity to engage at the intersection of machine learning, high-performance computing, and distributed systems.

• Bachelor's degree or above in computer science or equivalent.
• 3+ years of experience with the full software development life cycle in production.
• 3+ years of experience with at least one programming language such as Python, C/C++, or a similar language.
• 2+ years of experience with system design of new or existing systems.
• Familiarity with LLM/transformer fundamentals such as attention mechanisms and various forms of parallelism.

• Implement and tune components of the distributed training stack for large-scale training and reinforcement learning workloads.
• Contribute to parallelism strategies such as data, tensor, and pipeline parallelism.
• Profile workloads to identify bottlenecks in compute, memory, collectives, or host overhead.
• Collaborate with compiler, runtime, and collectives engineers to resolve performance issues.
• Build and maintain internal tooling, benchmarks, and tests to ensure reproducibility of performance work.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.