The Apple Silicon GPU SW architecture team is looking for a senior/principal engineer to lead initiatives in server-side ML acceleration and multi-node distribution. This role focuses on architecting and building next-generation distributed ML infrastructure to support Apple Intelligence. The engineer will tackle challenges related to orchestrating large network models across server clusters and optimizing hardware utilization. This position combines technical leadership with hands-on involvement in performance profiling and optimization techniques.

• 10+ years of experience in GPU programming (CUDA, ROCm) and high-performance computing.
• Strong experience with inter-node communication technologies (InfiniBand, RDMA, NCCL) in the context of ML training/inference.
• Excellent system programming skills in C/C+.
• Deep understanding of distributed systems and parallel computing architectures.
• Familiarity with tensor frameworks (PyTorch, JAX, TensorFlow) used in distributed training/inference.
• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field.
• Proven track record in ML infrastructure at scale.
• Python experience is a plus.
• PhD in Computer Science, Engineering, Mathematics, or a related technical field is preferred.

• Lead the design and implementation of distributed ML infrastructure.
• Architect systems to optimize performance and scalability for large-scale workloads.
• Collaborate with silicon architects to influence future GPU designs.
• Profile performance and implement optimization techniques for real-time user experiences.
• Address scaling challenges in delivering AI experiences through Apple's cloud infrastructure.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.