We are looking for a highly skilled machine learning engineer to join the AIML Evaluation team at Apple. This role focuses on building systems that evaluate and refine Apple's foundation models and agents. You will collaborate with product teams to enhance AI experiences through the design of benchmarks and optimization pipelines. The position offers the opportunity to contribute to advancements in large language models and agentic systems that impact millions of users.

• Strong background in machine learning and distributed systems
• 8+ years of professional experience as a software engineer, preferably in machine learning or a related field
• Bachelor's or Master's degree in Computer Science or a related field
• Experience building and maintaining ML infrastructure for evaluation, training, or deployment
• Proficiency in Python and ML frameworks such as PyTorch
• Experience with LLM evaluation, LLM-as-judge, or reward modeling
• Experience with prompt optimization, agent harness development, or post-training techniques
• Familiarity with on-device or privacy-preserving ML
• Excellent communication skills
• Proactive and determined problem-solving skills

• Design and develop benchmarks, evaluators, and simulation environments for model evaluation.
• Build automated prompt and context optimization pipelines.
• Collaborate with product and research teams to translate failure analysis into measurable improvements.
• Contribute datasets, environments, and reward signals to enhance model and agent quality.
• Engage with product teams across Apple to support a broad range of AI products.
• Work on agent and model evaluation across offline, device-in-the-loop, and on-device settings.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.