The Foundation Model Inference team within Cloud OS and AI Inference organization is focused on building a high-performance, secure, and private inference stack that powers various Apple services. This role involves working at the intersection of research and production, collaborating with the Foundation Model Research team and external partners. The main focus is on optimizing inference systems for large foundation models while ensuring performance and trust at scale. This position offers a unique opportunity to influence AI deployment for billions of users worldwide.

• 5+ years of experience leading complex, ambiguous technical projects from end to end.
• Hands-on experience with LLM inference stacks.
• Working knowledge of GPU or TPU programming concepts.
• Proficiency with PyTorch, JAX, or TensorFlow.
• Experience building and operating high-throughput services at large distributed scale.
• Proficiency deploying applications on cloud platforms (AWS, GCP, or equivalent) using Kubernetes and Docker.
• BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.
• Experience building production systems in Go or Python.
• Strong knowledge of deep learning architectures including Transformers, encoder/decoder models, and multimodal variants.
• Experience with inference optimization frameworks such as TensorRT-LLM, vLLM, SGLang, TGI, or Nvidia Triton Server.
• Experience authoring custom CUDA kernels using CUDA C++ or OpenAI Triton.
• MS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.

• Shape the technical direction for engineers by owning hard problems in inference efficiency and systems architecture.
• Collaborate closely with the Foundation Model Research team to transition cutting-edge model architectures from prototype to deployment.
• Build and optimize inference systems on Apple's privacy-preserving cloud infrastructure.
• Work with platform and security teams to ensure performance and trust at scale.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.