The Sr. Software Development Engineer will join the Inference Model Enablement team to optimize state-of-the-art open-source and customer LLMs for inference on Trainium accelerators. This role focuses on enhancing model enablement speed and experience while improving usability and quality through various features and optimizations. The engineer will lead technical initiatives, mentor team members, and collaborate with cross-functional teams to deliver high-performance models. The position requires a strong background in software development and machine learning.

• 5+ years of programming experience using a modern programming language such as Java, C++, or C#.
• 5+ years of experience leading design or architecture of new and existing systems.
• 5+ years of experience in the full software development life cycle.
• 5+ years of non-internship professional software development experience.
• Experience as a mentor or tech lead in an engineering team.
• Master's degree in computer science or equivalent.
• Experience with Machine Learning and Large Language Model fundamentals.

• Deliver high-performance models using distributed inference libraries.
• Drive technical excellence in performance optimization and system reliability across the Neuron ecosystem.
• Mentor team members and provide technical leadership across multiple work streams.
• Drive architectural decisions that impact the entire Neuron serving stack.
• Collaborate with customers, product owners, and engineering teams to define technical strategy.
• Author technical documentation, design proposals, and architectural guidelines.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.