The role is part of the Foundation Model Infrastructure team within Apple's AI, Search & Knowledge Platforms Technologies organization. This team is responsible for building frameworks, services, and tools that support Apple's foundation models, impacting various services like Apple Search and Siri. The position involves optimizing large-scale language, vision, and speech models using advanced technologies. The candidate will work closely with research and product teams to deliver production-grade solutions that serve millions of users in real time.

• 7+ years of experience leading and driving complex, ambiguous projects.
• Experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes and Docker.
• Familiar with GPU programming concepts using CUDA.
• Familiar with one of the popular ML Frameworks like Pytorch or Tensorflow.
• Proficient in building and maintaining systems written in modern languages such as Golang or Python.
• Familiar with fundamental Deep Learning architectures such as Transformers and Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, and Nvidia Triton Server.
• Experience writing custom CUDA kernels using CUDA or OpenAI Triton.

• Work alongside the Foundation Model Research team to optimize inference for cutting-edge model architectures.
• Collaborate closely with product teams to build production-grade solutions that launch models serving millions of customers in real time.
• Build tools to identify bottlenecks in inference for different hardware and use cases.
• Mentor and guide engineers within the organization.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.