The Software Development Engineer role on the Inference Model Enablement team focuses on optimizing state-of-the-art open-source and customer large language models for inference on Amazon's Trainium accelerators. The team is responsible for delivering high-performance models and driving improvements in model enablement speed and experience. This position involves collaboration with cross-functional teams and mentoring junior engineers. The role also emphasizes technical leadership and architectural decision-making within the Neuron ecosystem.

• 5+ years of programming experience using a modern programming language such as Java, C++, or C#.
• 5+ years of experience leading design or architecture of new and existing systems.
• 5+ years of experience in the full software development life cycle.
• 5+ years of non-internship professional software development experience.
• Experience as a mentor or tech lead.
• Master's degree in computer science or equivalent.
• Experience with Machine Learning and Large Language Model fundamentals.

• Deliver high-performance models using distributed inference libraries.
• Drive technical excellence in performance optimization and system reliability across the Neuron ecosystem.
• Mentor team members and provide technical leadership across multiple work streams.
• Drive architectural decisions that impact the entire Neuron serving stack.
• Collaborate with customers, product owners, and engineering teams to define technical strategy.
• Author technical documentation, design proposals, and architectural guidelines.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.