The Machine Learning Engineer specializing in Evaluation will focus on establishing evaluation criteria, metrics frameworks, and quality standards for machine learning models across Wallet, Payments, and Commerce. This role emphasizes the importance of rigorous evaluation to ensure AI systems are reliable and fair. The engineer will collaborate with various teams, including ML Engineering, Product, Privacy, and Legal, to shape model quality and influence product decisions. The ideal candidate will possess a strong understanding of model evaluation and a commitment to high-quality standards.

• M.S. in Machine Learning, Computer Science, Statistics, Applied Mathematics, or a related technical field strongly preferred.
• Bachelor's degree with 7+ years hands-on experience in ML evaluation, model quality, or applied research will be considered.
• 5+ years of hands-on ML experience, with deep expertise in model evaluation, offline metrics design, and behavioral testing.
• Strong track record designing evaluation frameworks for production ML systems.
• Experience testing for distribution shift, out-of-distribution generalization, and temporal drift in real-world deployed models.
• Strong programming skills in Python and fluency with evaluation tooling, data pipelines, and experiment tracking.
• Excellent communication skills to translate metric results into product-quality narratives for engineering and executive audiences.

• Establish evaluation criteria, metrics frameworks, and quality standards for machine learning models.
• Design adversarial test strategies and surface failure modes before they reach users.
• Own the full evaluation lifecycle for ML models across Wallet features.
• Construct adversarial test suites and edge-case corpora to identify model failure modes.
• Make final quality calls before any model ships.
• Collaborate closely with ML Engineering, Product, Privacy, and Legal teams.
• Influence model development priorities and product decisions at scale.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.