The Productivity and Machine Learning Evaluation team focuses on ensuring the quality of AI-powered features across various productivity and creative applications. This role serves as the analytical core of the team, responsible for interpreting evaluation signals and user behavior. The position involves designing quality metrics and collaborating on data collection strategies to translate evaluation data into actionable insights. As AI features evolve, this role will define what quality means in the context of multi-turn conversations.

• Bachelor's degree in Statistics, Data Science, Applied Mathematics, Computer Science, or a related quantitative field
• 5+ years of experience in applied science, data science, or evaluation research, with a focus on defining and operationalizing quality metrics
• Experience with statistical analysis methods including significance testing, sampling design, effect size estimation, and experimental design
• Proficiency in Python or R for data analysis and visualization
• Experience designing evaluation or quality metrics for AI-powered or ML-driven features in consumer-facing products

• Analyze evaluation results and identify trends, regressions, and segment-level patterns across multiple AI features.
• Collaborate with partner teams on data collection strategies to ensure evaluation data is representative of real-world usage.
• Design the metrics framework that leadership uses to make decisions on AI features.
• Translate complex analytical findings into concise recommendations for non-technical decision-makers.
• Manage evaluation across multiple features or product areas simultaneously with systematic approaches.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.