As a Machine Learning Engineer specializing in Evaluation, you will focus on establishing evaluation criteria, metrics frameworks, and quality standards for ML models across Wallet, Payments, and Commerce. Your work will ensure that AI systems are reliable and accountable to fairness standards, impacting hundreds of millions of users. You will collaborate closely with ML Engineering, Product, Privacy, and Legal teams to shape model quality and influence product decisions. This role emphasizes the importance of rigorous evaluation in machine learning, aiming to meet high standards of accuracy, robustness, and reliability.

• M.S. in Machine Learning, Computer Science, Statistics, Applied Mathematics, or a related technical field strongly preferred.
• Bachelor's degree with 7+ years hands-on experience in ML evaluation, model quality, or applied research will be considered.
• 5+ years of hands-on ML experience, with deep expertise in model evaluation, offline metrics design, and behavioral testing.
• Strong track record designing evaluation frameworks for production ML systems, including precision-recall tradeoffs and fairness.
• Strong programming skills in Python and fluency with evaluation tooling and data pipelines.

• Establish evaluation criteria and metrics frameworks for ML models.
• Design adversarial test strategies and benchmarks that reflect the diversity of Apple's global user base.
• Own the full evaluation lifecycle for ML models across Wallet features.
• Make final quality calls before any model ships, influencing model development priorities.
• Translate metric results into product-quality narratives for engineering and executive audiences.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.