The Productivity and Machine Learning Evaluation team focuses on ensuring the quality of AI-powered features across various productivity and creative applications. This analytical role involves interpreting evaluation signals and user behavior to inform decisions on model development and product direction. The position requires designing quality metrics and collaborating with partner teams to collect representative data. As AI features evolve, the role will redefine quality assessment in the context of multi-turn conversations.

• Bachelor's degree in Statistics, Data Science, Applied Mathematics, Computer Science, or a related quantitative field
• 5+ years of experience in applied science, data science, or evaluation research, focusing on defining and operationalizing quality metrics
• Experience with statistical analysis methods including significance testing, sampling design, effect size estimation, and experimental design
• Proficiency in Python or R for data analysis and visualization
• Experience designing evaluation or quality metrics for AI-powered or ML-driven features in consumer-facing products

• Analyze evaluation results to identify trends, regressions, and segment-level patterns across multiple AI features
• Collaborate with partner teams on data collection strategies to ensure evaluation data is representative of real-world usage
• Design the metrics framework that leadership uses to make decisions on AI features
• Translate evaluation data into concise, actionable insights for decision-makers
• Manage evaluation across multiple features or product areas simultaneously with systematic approaches

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.