The Sr. Software Development Engineer will join the AWS Mantle team to build the infrastructure for a distributed inference engine that serves millions of customers. This role focuses on defining the technical vision and addressing large-scale challenges in machine learning systems and distributed computing. The team is dedicated to providing secure access to high-performing foundation models while maintaining operational excellence. Candidates should be prepared to navigate complex trade-offs and influence engineering strategy across Amazon Bedrock.

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience with at least one modern language such as Java, C++, Python, Go, or Rust
• 5+ years of leading design or architecture of new and existing systems experience
• Experience as a mentor, tech lead, or leading an engineering team
• Bachelor's degree in Computer Science, Engineering, a related field, or equivalent experience
• Experience driving cross-organizational technical strategy in complex environments
• 5+ years of full software development life cycle experience
• Master's degree or equivalent in computer science, machine learning, engineering, or related fields, or PhD
• Experience building large-scale machine learning and AI solutions at Internet scale
• Familiarity with inference frameworks such as vLLM, TensorRT, or Triton Inference Server

• Set the long-term technical direction for a globally distributed ML inference platform
• Own end-to-end system design decisions impacting latency, reliability, and scalability
• Influence engineering strategy across Amazon Bedrock and align technical investments with business outcomes
• Raise the engineering bar through exemplary system design and mentorship
• Navigate complex trade-offs across performance, security, and cost
• Design and evolve the architecture of Mantle's distributed inference engine
• Drive cross-organizational initiatives to deliver seamless API experiences with security guarantees
• Lead technical strategy for scaling inference to support rapid onboarding of new foundation models

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.