Apple's iCloud Platform Engineering is seeking an Engineering Manager to lead the routing of PCC inference requests across a global fleet. This role involves guiding architectural direction, scaling operational practices, and developing engineers and leaders to enhance cloud inference delivery. The position requires a strong technical background and the ability to thrive in complex environments while ensuring low latency and high availability. The manager will also focus on privacy-preserving designs and improving the performance of Apple's AI services.

• Extensive software engineering experience with a track record of leading teams that design, build, and operate large-scale distributed systems.
• Proven ability to recruit, develop, and retain high-performing engineers and leaders.
• Experience delivering API gateways, request routing, load balancing, or traffic management systems at scale.
• Expertise in LLM inference serving, including request routing and KV-cache placement.
• A record of shipping highly reliable systems in high-availability environments.
• Strong technical depth with a server development background in Java, C/C++, Go or Swift.
• Ability to drive alignment and execution across teams in complex environments.
• Bachelor's degree in an engineering discipline or equivalent professional experience.
• Proven leadership in developing LLM inference serving or routing platforms.
• Experience building or running inference AI gateways and their core behaviors.
• Track record of scaling teams and organizations during rapid growth.
• Experience delivering capacity tiers or improving accelerator utilization through routing.
• Understanding of privacy-preserving system design.
• Experience designing and maturing observability practices.
• Experience with container orchestration systems such as Kubernetes.
• Demonstrated ability to build psychologically safe, high-trust team environments.
• Experience formulating multi-year roadmaps in collaboration with product and senior leadership.

• Lead the design of routing and scheduling strategies within a privacy model.
• Guide architectural direction and scale operational practices.
• Develop engineers and leaders to shape cloud inference delivery.
• Evaluate techniques such as cache-aware request placement and prefill/decode disaggregation.
• Grow a high-performing organization and set a clear technical roadmap.
• Improve routing latency, availability, and fleet utilization.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.