The role is focused on developing high-performance, distributed inference solutions for GenAI applications on Apple’s Private Cloud Compute. The team specializes in GPU acceleration of machine learning training frameworks and seeks engineers passionate about scalable and efficient solutions. Candidates will work with custom-built server hardware and have the opportunity to influence the design of next-generation GPU architectures. The position emphasizes collaboration with hardware and systems teams to optimize performance.

• 3+ years of programming and problem-solving experience with C/C++/ObjC
• Experience with GPU kernel development and optimizations using compute programming models such as Metal and CUDA
• Experience with system level programming and computer architecture
• Experience with distributed training or inference techniques
• Experience with graph compilers such as Triton, OpenXLA or LLVM/MLIR is a plus
• Contributions to an AI framework such as PyTorch, JAX or Tensorflow is a plus
• Good understanding of machine learning fundamentals

• Work on cutting-edge ML inference framework projects and optimize code for efficient and scalable ML inference using distributed compute strategies.
• Develop kernel and compiler level optimizations and perform in-depth analysis to ensure the best possible performance across server hardware families.
• Apply advanced model optimization techniques including speculation, quantization, and compression to maximize throughput and minimize latency.
• Collaborate closely with hardware, compiler, and systems teams to align software performance with hardware capabilities.
• Analyze and improve performance metrics such as end-to-end latency, TTFT, TBOT, memory footprint, and compute efficiency.
• Implement features of Metal device backend for ML training acceleration technologies.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.