Sr Software Dev Engineer, Edge AI ML Platform (Level 6), Edge AI

Job Description

Join our Edge AI team at Amazon Devices (Lab126) to architect and implement distributed training systems for large language models to run on edge devices.

Requirements

• 5+ years of non-internship professional software development experience
• Experience with distributed systems or high-performance computing
• Proficiency in Python and at least one systems programming language (C++, Rust, etc.)
• Experience with machine learning frameworks such as PyTorch or TensorFlow
• Understanding of GPU programming and optimization techniques

Responsibilities

• Architect and implement distributed training systems that efficiently scale across hundreds or thousands of GPUs
• Design and optimize data parallelism, tensor parallelism, and pipeline parallelism strategies for large language models
• Develop infrastructure that supports novel distillation and compression techniques for edge deployment
• Collaborate with ML scientists to optimize training for downstream compression requirements
• Benchmark and profile training configurations to maximize throughput and GPU utilization

Benefits

• Medical, dental, and vision coverage (multiple plan options)
• Health savings and flexible spending accounts
• 24/7 Employee Assistance Program for mental health support
• 401(k) with company match and various investment choices
• Company-paid life/AD&D and disability insurance
• Restricted stock units (RSUs) for employee ownership
• Child care and elder care referrals, adoption assistance
• Paid maternity and parental leave (including Ramp Back)
• Paid time off (PTO) and company holidays
• Employee discount on Amazon.com products
• Career Choice program (95% tuition and textbook coverage)