The Principal Software Development Engineer will join the AWS Mantle team to shape the technical vision for a distributed inference engine that serves millions of customers. This role focuses on defining large-scale technical challenges at the intersection of machine learning, distributed computing, and security. The team is dedicated to building a high-performance ML inference platform that emphasizes customer trust and operational excellence. The ideal candidate will thrive in ambiguity and contribute to the future of AI infrastructure.

• 10+ years of non-internship professional software development experience
• 10+ years of leading design or architecture of new and existing systems experience
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
• 8+ years of programming experience with at least one modern language such as Java, C++, Python, Go, or Rust
• Experience driving cross-organizational technical strategy and delivering results in complex environments
• Master's degree or equivalent in computer science, machine learning, engineering, or related fields, or PhD
• Experience building large-scale machine learning and AI solutions at Internet scale
• Experience working with Advanced Compute technologies including Accelerated Compute and High Performance Compute
• Experience writing and publishing technical documents
• Familiarity with inference frameworks such as vLLM, TensorRT, or Triton Inference Server

• Set the long-term technical direction for a globally distributed ML inference platform
• Own end-to-end system design decisions impacting latency, reliability, and scalability
• Influence engineering strategy across Amazon Bedrock and align technical investments with business outcomes
• Design and evolve the architecture of Mantle's distributed inference engine
• Drive cross-organizational initiatives to deliver seamless API experiences with security guarantees
• Lead technical strategy for scaling inference to support rapid onboarding of new foundation models
• Author and champion technical vision documents and represent the team in executive-level reviews
• Mentor and develop senior engineers, fostering a culture of engineering excellence and innovation

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.