Sr. Research Engineer, Machine Learning, AGI Foundations

Job Description

Senior Research Engineer position with the AGI team at Amazon focusing on developing industry-leading multimodal large-language foundational models.

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture of new and existing systems experience
• Experience as a mentor, tech lead, or leading an engineering team
• 2+ years of expertise in Machine Learning and/or Model Training
• Master's degree in machine learning or equivalent
• Hands-on experience and expertise in training Foundational Models/LLMs, and/or low-level optimization of ML training workflows, CUDA kernels, network I/O

Responsibilities

• Responsible for pre and post-training multimodal LLMs
• Scale training of models on hyper large GPU and AWS Trainium clusters
• Optimize training workflows using distributed training/parallelism techniques
• Optimize low-level details of the training stack, including CUDA kernels, communication collectives, network I/O
• Utilize, build and extend upon industry-leading frameworks
• Work with other team members to investigate design approaches, prototype new technology, scientific techniques, and evaluate technical feasibility
• Deliver results independently in a self-organizing Agile environment

Benefits

• Medical, dental, and vision coverage (multiple plan options)
• Health savings and flexible spending accounts
• 24/7 Employee Assistance Program for mental health support
• 401(k) with company match and various investment choices
• Company-paid life/AD&D and disability insurance
• Restricted stock units (RSUs) for employee ownership
• Child care and elder care referrals, adoption assistance
• Paid maternity and parental leave (including Ramp Back)
• Paid time off (PTO) and company holidays
• Employee discount on Amazon.com products
• Career Choice program (95% tuition and textbook coverage)