Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Job Description

This role is for a software engineer in the Machine Learning Inference Model Enablement team for AWS Neuron at Annapurna Labs, responsible for development, enablement, and performance tuning of machine learning models on AWS Inferentia and Trainium.

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of non-internship design or architecture experience
• Experience optimizing inference performance on large models using Python, Pytorch, or JAX
• Experience with Deepspeed and other distributed inference libraries
• Fundamentals of Machine learning and LLMs
• Masters degree in computer science or equivalent
• Experience programming with at least one software programming language

Responsibilities

• Lead efforts building distributed inference support for Pytorch in the Neuron SDK
• Tune models to ensure highest performance on AWS Trainium and Inferentia silicon
• Participate in design discussions, code review, and communication with stakeholders
• Work cross-functionally to drive business decisions with technical input
• Build high-impact solutions for customers

Benefits

• Medical, dental, and vision coverage (multiple plan options)
• Health savings and flexible spending accounts
• 24/7 Employee Assistance Program for mental health support
• 401(k) with company match and various investment choices
• Company-paid life/AD&D and disability insurance
• Restricted stock units (RSUs) for employee ownership
• Child care and elder care referrals, adoption assistance
• Paid maternity and parental leave (including Ramp Back)
• Paid time off (PTO) and company holidays
• Employee discount on Amazon.com products
• Career Choice program (95% tuition and textbook coverage)