As a Senior Software Engineer on the AWS Neuron team, you will play a pivotal role in optimizing and deploying advanced AI models using AWS's next-generation AI accelerators, Inferentia and Trainium. The team focuses on pioneering distributed inference solutions and collaborating with silicon architects to enhance AI acceleration. You will be responsible for driving performance improvements and developing tools that set industry standards for machine learning deployment. This position offers a unique opportunity to influence AWS's AI infrastructure and work at the intersection of machine learning frameworks and custom silicon.

• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• 5+ years of programming experience using Python or C++ and PyTorch.
• Experience with AI acceleration techniques such as quantization, parallelism, model compression, batching, KV caching, and vllm serving.
• Experience with accuracy debugging and tooling, as well as performance benchmarking of AI accelerators.
• Master's degree in computer science or machine learning or equivalent.
• Experience in developing CUDA kernels, HPC, and inference optimization.

• Pioneer distributed inference solutions for industry-leading large language models such as GPT, Llama, and Qwen.
• Optimize breakthrough language and vision generative AI models.
• Collaborate directly with silicon architects and compiler teams to enhance AI acceleration.
• Drive performance benchmarking and tuning that impacts millions of inference calls globally.
• Architect the bridge between machine learning frameworks and AI hardware.
• Spearhead distributed inference architecture for PyTorch and JAX using XLA.
• Engineer performance optimizations for AWS Trainium and Inferentia.
• Develop machine learning tools to enhance LLM accuracy and efficiency.
• Transform complex tensor operations into optimized hardware implementations.
• Pioneer benchmarking methodologies that shape next-gen AI accelerator design.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.