The Foundation Model Services team within Apple's Machine Learning Platform Technologies organization is responsible for building frameworks, services, and tools that support Apple's foundation models. This role involves optimizing language, vision, and speech models to serve millions of users globally. The team focuses on delivering production-grade solutions in real-time and collaborating with research teams to develop cutting-edge model architectures. This position offers the opportunity to impact the lives of people by enhancing Apple's intelligence capabilities.

• 5 years or more of industry experience in machine learning technologies including LLMs, NLP, and statistics.
• Experience with high throughput services, particularly at supercomputing scale.
• Proficiency in running applications on cloud platforms such as AWS or Azure using Kubernetes and Docker.
• Proficiency in building and maintaining systems using modern programming languages like Golang and Python.
• Bachelor's degree or higher in Computer Science or a related technical field.
• Familiarity with popular machine learning frameworks such as PyTorch or TensorFlow.
• Knowledge of fundamental deep learning architectures including Transformers and Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server.

• Work closely with product teams to build production-grade solutions that launch models serving millions of customers in real-time.
• Collaborate with the Foundation Model Research team to prototype and develop inference for cutting-edge model architectures.
• Build tools to identify bottlenecks in inference across different hardware and use cases.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.