This role is for a software engineer in the Machine Learning Applications team for AWS Neuron, focusing on developing and optimizing building blocks for machine learning model families. The team works closely with inference model enablement and compiler runtime engineers to create high-performance distributed inference solutions for Trainium accelerators. The environment is fast-paced and encourages knowledge-sharing and mentorship among team members. The role requires experience in optimizing LLM inference performance and involves collaboration with various stakeholders.

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience of new and existing systems
• Experience programming with at least one software programming language
• 3+ years of full software development life cycle experience, including coding standards and code reviews
• Bachelor's degree in computer science or equivalent

• Develop optimized building blocks for the Neuron distributed inference library.
• Tune components to ensure highest performance and maximize efficiency on Trn2 and Trn3 servers.
• Create metrics and implement automation and other improvements.
• Resolve the root cause of software defects.
• Participate in design discussions and code reviews.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.