Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Job Description

AWS Neuron is looking for a software engineer to join the Machine Learning Inference Model Enablement team at Annapurna Labs to work on developing, enabling, and performance tuning of various large language models for AWS Inferentia and Trainium.

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of non-internship design or architecture experience
• Experience with Machine learning and LLMs
• Experience programming with at least one software programming language

Responsibilities

• Lead efforts in building distributed inference support for Pytorch in the Neuron SDK
• Tune models for highest performance on AWS Trainium and Inferentia silicon and servers
• Participate in design discussions, code reviews, and communicate with stakeholders
• Work in a startup-like development environment

Benefits

• Medical, dental, and vision coverage (multiple plan options)
• Health savings and flexible spending accounts
• 24/7 Employee Assistance Program for mental health support
• 401(k) with company match and various investment choices
• Company-paid life/AD&D and disability insurance
• Restricted stock units (RSUs) for employee ownership
• Child care and elder care referrals, adoption assistance
• Paid maternity and parental leave (including Ramp Back)
• Paid time off (PTO) and company holidays
• Employee discount on Amazon.com products
• Career Choice program (95% tuition and textbook coverage)