The role is part of the Foundation Model Services team within Apple's Machine Learning Platform Technologies organization, focusing on building frameworks, services, and tools that support Apple's foundation models. This team powers various Apple services, including Apple Search and Siri, and aims to optimize language, vision, and speech models at scale. The position offers an opportunity to impact billions of users by developing production-grade solutions and collaborating with research teams on cutting-edge model architectures. Candidates will work on enhancing inference performance across different hardware and use cases.

• 5 years or more of industry experience in machine learning technologies, including LLMs, NLP, and statistics.
• Experience with high throughput services, particularly at supercomputing scale.
• Proficiency in running applications on cloud platforms such as AWS or Azure using Kubernetes and Docker.
• Proficiency in building and maintaining systems using modern programming languages like Golang and Python.
• Bachelor's degree or higher in Computer Science or a related technical field.
• Familiarity with popular ML frameworks such as Pytorch or Tensorflow.
• Understanding of fundamental deep learning architectures, including Transformers and Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server.

• Work closely with product teams to build production-grade solutions for launching models that serve millions of customers in real time.
• Collaborate with the Foundation Model Research team to prototype and develop inference for cutting-edge model architectures.
• Build tools to identify bottlenecks in inference for various hardware and use cases.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.