The Senior Inference Engineer will focus on real-time multimodal conversational AI, overseeing the entire model path from research to production. This full-stack role involves optimizing model architecture for servability, building real-time runtimes under strict latency budgets, and developing offline training systems. The engineer will collaborate closely with scientists and hardware partners to ensure efficient model performance. This position offers the opportunity to tackle complex problems in a cutting-edge environment.

• 3+ years of building machine learning models for business applications experience
• PhD or Master's degree and 6+ years of applied research experience
• Experience programming in Java, C++, Python or related languages
• 2+ years of hands-on experience optimizing inference for neural models
• Strong understanding of deep learning architectures and their application to multimodal domains
• Experience with GPU performance optimization and memory management
• Experience with modeling tools such as R, scikit-learn, Spark MLLib, Tensorflow, and numpy
• Familiarity with model-compression and efficiency techniques
• Experience with distributed training and post-training pipelines
• Background in speech-to-speech or audio generative models

• Partner with research scientists to make model architectures servable from inception.
• Implement and optimize the inference path for large-scale multimodal models.
• Own the real-time serving path for streaming multimodal conversational AI.
• Build and tune continuous batching and scheduling for interactive workloads.
• Establish latency, throughput, and cost benchmarking for deployment.
• Build and scale offline inference systems for reinforcement learning.
• Ensure train/serve consistency in the inference path used in evaluation.
• Profile end-to-end performance to identify and eliminate bottlenecks.
• Customize production serving frameworks for real-time streaming generative models.

• Employees at Amazon are often offered comprehensive health benefits—including multiple medical plan options (no pre-existing condition exclusions, 100% covered in-network preventive care), dental and vision plans, a 24/7 medical advice line from day one, expert second-opinion services, and broad mental-health support with several free counseling sessions (including pediatric). Financial wellness typically includes a 401(k) with company match (up to 2%), Restricted Stock Units (equity), FSAs, an emergency savings program, product and partner discounts, and even college-savings and home-purchase programs. Overall, the package is designed to support employees and their families’ health, finances, and day-to-day life.