The role involves leading efforts to optimize distributed training performance on AWS Trainium, focusing on training throughput and model utilization. The team works at the intersection of machine learning, high-performance computing, and distributed systems, collaborating closely with customers to ensure efficient model training. Engineers will engage in hardware and software co-design, addressing performance gaps and contributing to future architecture designs. This position offers a unique opportunity to mentor experienced engineers while working in a dynamic and innovative environment.

• Bachelor's degree in computer science or equivalent.
• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years of experience leading design or architecture of new and existing systems.
• 5+ years of experience in the full software development life cycle.
• Experience as a mentor or tech lead.
• Experience in machine learning, data mining, or natural language processing.
• Master's degree in computer science or equivalent is preferred.
• Experience in computer architecture.
• Previous software engineering expertise with PyTorch, JAX, or TensorFlow.

• Lead efforts to optimize distributed training performance on Trainium.
• Focus on training throughput, model FLOPs utilization, and time to convergence.
• Work across PyTorch, JAX, and the Neuron compiler and runtime.
• Identify missing operators and sharding strategies for new model architectures.
• Own the parallelism strategies for model training.
• Profile workloads to determine performance bottlenecks.
• Translate performance gaps into requirements for future Trainium architecture.
• Collaborate with applied scientists, system engineers, and product managers.
• Debug performance issues and optimize memory usage.
• Create metrics and implement automation to improve software architecture.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.