This senior software engineering role is part of the Machine Learning Inference Applications team, focusing on delivering high-performance model inference solutions for customer workloads on AWS Inferentia and Trainium. The engineer will lead the development of core serving technologies within open-source frameworks to enable efficient large-scale inference. Collaboration with model development, performance, compiler, and runtime engineers is essential to ensure optimal model performance. The team values mentorship and knowledge-sharing, fostering an environment for career growth.

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience with at least one software programming language
• 5+ years of experience leading design or architecture of new and existing systems
• 5+ years of experience in the full software development life cycle
• Experience as a mentor or tech lead
• Fundamentals of machine learning models and their lifecycles
• Bachelor's degree in computer science or equivalent
• Hands-on experience with PyTorch or JAX
• Experience extending or contributing to inference frameworks such as vLLM or SGLang
• Kernel development experience

• Lead the customization and optimization of open-source inference frameworks on AWS Neuron.
• Apply state-of-the-art techniques in kernel development and systems engineering.
• Influence the team's technical roadmap by evaluating emerging inference research.
• Collaborate closely with model development, compiler, runtime, and performance engineering teams.
• Drive excellence in inference framework optimization and engineering best practices.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.