This role involves working on frontier foundation models that enhance intelligent experiences at Apple. The team focuses on the entire training lifecycle, including pre-training and mid-training approaches tailored for Apple silicon. The position emphasizes evaluating models to provide actionable insights that improve user experience. Candidates will engage in solving complex problems related to reward modeling and model alignment across various tasks.

• 3+ years of experience in AI model evaluation, NLP, or a related area.
• Strong fundamentals in machine learning, natural language processing, and statistical analysis.
• Proficiency in Python and experience with ML frameworks such as PyTorch or JAX.
• Demonstrated ability to translate research insights into practical implementations.
• Strong experimental design skills with the ability to draw valid conclusions from results.
• Clear technical communication skills to distill evaluation results into actionable recommendations.
• MS or PhD in Computer Science, Machine Learning, Natural Language Processing, or a related technical field.

• Design evaluation systems that provide actionable signals for model improvement.
• Benchmark models against state-of-the-art capabilities in reasoning and workflows.
• Measure model quality in ways that reflect real user experiences.
• Integrate evaluation insights back into the model development cycle.
• Collaborate with model training and product teams to enhance model performance.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.