This role involves leveraging engineering and machine learning expertise to develop generative AI for shopping at Amazon. The SFAI Training Infrastructure team focuses on building a unified platform for large-scale LLM training, addressing challenges at the intersection of distributed systems and machine learning. The team aims to create scalable, reliable, and efficient systems that enhance the training process. Candidates will work closely with talented scientists and engineers to innovate and improve customer experience.

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience of new and existing systems
• Experience programming with at least one software programming language
• Knowledge of Machine Learning and LLM fundamentals, including transformer architecture and optimization techniques
• Knowledge of ML frameworks including JAX, PyTorch, and TensorRT
• Experience with CUDA/C++/Kernel development

• Design and implement a stable and efficient training system for model training and reinforcement learning.
• Collaborate with applied scientists and engineers to improve training efficiency and reliability.
• Design and implement scalable data infrastructure for Amazon-scale data ingestion and processing.
• Build end-to-end RL post-training pipelines at cluster scale.
• Optimize RL training stability by monitoring and tuning key metrics.
• Profile and eliminate bottlenecks across compute, networking, and storage.
• Build observability systems for training dynamics and experiment tracking.
• Contribute to system design and long-term technical roadmap.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.