The role is focused on working with Apple's ML Frameworks team to enhance high-performance, distributed inference for GenAI applications on Private Cloud Compute. Engineers will engage with custom-built server hardware that leverages Apple silicon's power and security. The team emphasizes GPU acceleration for ML training frameworks like PyTorch and JAX. Candidates should be passionate about creating scalable and efficient solutions for high-throughput GPU execution.

• 2+ years of programming and problem-solving experience with C/C++/ObjC
• Experience with GPU kernel development and optimizations using compute programming models such as Metal and CUDA
• Experience with system level programming and computer architecture
• Experience with distributed training or inference techniques
• Experience with graph compilers such as Triton, OpenXLA or LLVM/MLIR is a plus
• Contributions to an AI framework such as PyTorch, JAX or TensorFlow is a plus
• Good understanding of machine learning fundamentals

• Work on cutting-edge ML inference framework projects and optimize code for efficient and scalable ML inference using distributed compute strategies.
• Develop kernel and compiler level optimizations and perform in-depth analysis to ensure the best possible performance across server hardware families.
• Apply advanced model optimization techniques including speculation, quantization, and compression to maximize throughput and minimize latency.
• Collaborate closely with hardware, compiler, and systems teams to align software performance with hardware capabilities.
• Analyze and improve performance metrics such as end-to-end latency, TTFT, TBOT, memory footprint, and compute efficiency.
• Implement features of Metal device backend for ML training acceleration technologies.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.