The Productivity and Machine Learning Evaluation team focuses on ensuring the quality of AI-powered features in productivity and creative applications. This role serves as the analytical core of the team, responsible for interpreting evaluation signals and user behavior. Key tasks include designing quality metrics and collaborating on data collection strategies. The position offers the opportunity to define quality measurement for evolving AI features, particularly in multi-turn conversational contexts.

• Bachelor's degree in Statistics, Data Science, Applied Mathematics, Computer Science, or a related quantitative field
• 5+ years of experience in applied science, data science, or evaluation research with a focus on defining and operationalizing quality metrics
• Experience with statistical analysis methods including significance testing and experimental design
• Proficiency in Python or R for data analysis and visualization
• Experience designing evaluation or quality metrics for AI-powered features in consumer-facing products
• Graduate degree in a relevant quantitative field

• Analyze evaluation results and identify trends and patterns across multiple AI features
• Collaborate with partner teams on data collection strategies to ensure data representativeness
• Design feature-level quality metrics and dashboards for decision-making
• Translate evaluation data into actionable insights for product direction
• Define evaluation approaches where the unit of analysis is a session or conversation
• Manage evaluation across multiple features or product areas systematically

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.