The role involves leading efforts to optimize distributed training performance on AWS Trainium, focusing on training throughput and model utilization. The team works at the intersection of machine learning and high-performance computing, collaborating closely with customers to enhance their training workloads. Engineers will engage in hardware and software co-design, addressing performance gaps across the Neuron software stack. This position offers a unique opportunity to shape AI acceleration technology while mentoring a team of experienced engineers.

• Bachelor's degree in computer science or equivalent.
• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years of experience leading design or architecture of new and existing systems.
• 5+ years of experience in the full software development life cycle.
• Experience as a mentor or tech lead.
• Experience in machine learning, data mining, or natural language processing.
• Master's degree in computer science or equivalent is preferred.
• Experience in computer architecture.
• Previous software engineering expertise with PyTorch, JAX, or TensorFlow.

• Lead efforts to optimize distributed training performance on Trainium.
• Work across PyTorch, JAX, and the Neuron compiler and runtime.
• Identify missing operators and sharding strategies for new model architectures.
• Own the parallelism strategies these models depend on.
• Profile workloads to determine performance bottlenecks.
• Translate performance gaps into requirements for future Trainium architecture.
• Collaborate with a cross-functional team to deliver inference capabilities.
• Debug performance issues and optimize memory usage.
• Design and code solutions to drive efficiencies in software architecture.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.