The role is part of the Foundation Model Services team within Apple's Machine Learning Platform Technologies organization, focusing on building frameworks and tools that support Apple's foundation models. This team powers various services at Apple, including Apple Search and Siri, and aims to optimize language, vision, and speech models at scale. The position offers the opportunity to impact billions of users globally by developing production-grade solutions and collaborating with research teams. Candidates will work on cutting-edge model architectures and enhance inference capabilities across different hardware.

• 5 years or more of industry experience in machine learning technologies, including LLMs, NLP, and statistics.
• Experience with high throughput services, particularly at supercomputing scale.
• Proficiency in running applications on cloud platforms such as AWS or Azure using Kubernetes and Docker.
• Proficiency in building and maintaining systems using modern programming languages like Golang and Python.
• Bachelor's degree or higher in Computer Science or a related technical field.
• Familiarity with popular ML frameworks such as Pytorch or Tensorflow.
• Understanding of fundamental deep learning architectures, including Transformers and Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server.

• Work closely with product teams to develop production-grade solutions for launching models that serve millions of customers in real time.
• Collaborate with the Foundation Model Research team to prototype and develop inference for cutting-edge model architectures.
• Build tools to identify bottlenecks in inference across different hardware and use cases.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.