As a Machine Learning Engineer specializing in Evaluation, you will focus on establishing evaluation criteria, metrics frameworks, and quality standards for ML models across Wallet, Payments, and Commerce. Your work will ensure that AI systems are reliable and meet high standards of fairness and accuracy. You will collaborate with various teams, including ML Engineering, Product, Privacy, and Legal, to shape model quality and influence product decisions. This role emphasizes the importance of rigorous evaluation in delivering exceptional machine learning solutions to millions of users.

• M.S. in Machine Learning, Computer Science, Statistics, Applied Mathematics, or a related technical field strongly preferred.
• Bachelor's degree with 7+ years hands-on experience in ML evaluation, model quality, or applied research will be considered.
• 5+ years of hands-on ML experience, with deep expertise in model evaluation, offline metrics design, and behavioral testing.
• Strong track record designing evaluation frameworks for production ML systems, including precision-recall tradeoffs and fairness.
• Strong programming skills in Python and fluency with evaluation tooling and data pipelines.

• Establish evaluation criteria and metrics frameworks for ML models.
• Design adversarial test strategies and benchmarks that reflect the diversity of Apple's global user base.
• Make final quality calls before any model ships to ensure high standards of accuracy and reliability.
• Collaborate closely with cross-functional teams to influence model development priorities.
• Construct adversarial test suites and edge-case corpora to surface model failure modes.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.