The role involves leading the development of distributed training solutions for AWS Neuron, focusing on PyTorch and JAX integration with Trainium accelerators. The team is dedicated to optimizing machine learning workloads and enhancing performance through innovative parallelism strategies. This position offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed systems. Candidates will contribute to both current performance improvements and future architecture designs.

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience with at least one software programming language
• 5+ years of experience leading design or architecture of new and existing systems
• Experience as a mentor, tech lead, or leading an engineering team
• Bachelor's degree or above in computer science or equivalent
• Familiarity with LLM/transformer fundamentals such as attention mechanisms and autoregressive decoding
• Experience in machine learning, data mining, information retrieval, statistics, or natural language processing
• Master's degree or above in computer science or equivalent
• Experience in developing and deploying LLMs in production on AI acceleration hardware
• Hands-on experience with SFT and/or RLHF/PPO/DPO
• Experience with ML frameworks such as PyTorch/JAX and distributed libraries
• Experience with performance engineering including workload profiling and optimization
• Contribution to open source projects

• Lead the effort to build distributed training and post-training support into PyTorch and JAX for Trainium accelerators.
• Work across the PyTorch and Neuron software stack to enable large-scale training and reinforcement learning workloads.
• Own the parallelism strategies for models, applying reduced-precision formats where beneficial.
• Profile workloads to determine performance bottlenecks and drive fixes with relevant engineering teams.
• Translate performance gaps into requirements that influence frameworks and contribute to open source projects.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.