The role is for a senior engineer in Apple's Evaluation organization, focusing on building platforms that measure quality across Apple Intelligence and Siri. This position involves owning critical parts of the evaluation platform and ensuring its direction, quality, and adoption. The engineer will work at the intersection of AI modeling, software engineering, and product quality. The team is expanding rapidly, requiring a strong foundation and structure for systems that support both product development and research.

• BS/MS/PhD in Computer Science, Machine Learning, or a related field.
• 8+ years of software engineering experience, including owning production systems used by other teams.
• Exceptional Python skills and a strong engineering understanding of system design, API design, system testing and validation, debugging and monitoring.
• Experience in shipping production code with AI coding agents while maintaining high quality.
• Proficiency in building agentic systems, LLM-based applications, and LLM-as-judge systems.

• Own major systems in the evaluation platform and be accountable for its direction and quality.
• Build and maintain technical integrations across multiple platforms in a large organization.
• Interpret evaluation results, including human agreement and run-to-run consistency.
• Support features that encompass both product development and research.
• Turn ambiguous requirements into a focused plan.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.