The Eval Systems Architect role at Apple involves defining the architecture of the systems that measure Siri's quality across various platforms and updates. This position is part of the Agentic Eval Engineering organization, focusing on building a coherent, scalable, and trustworthy evaluation infrastructure. The architect will work closely with teams to ensure architectural coherence and drive the technical roadmap for the evaluation platform. This role directly influences the evaluation of Apple's AI products, impacting the quality and speed of Siri's deployment to users.

• BS/MS/PhD in Computer Science, Software Engineering, or a related field.
• 10+ years of software engineering experience, with at least 5 years in a systems architecture, staff/principal engineer, or technical leadership role.
• Proven track record of designing and shipping large-scale distributed systems serving multiple teams or organizations.
• Deep expertise in system design, including API design, service architecture, and data flow modeling.
• Solid software engineering fundamentals with production experience, including CI/CD and testing strategies.
• Demonstrated expertise in using AI-assisted software development workflows.
• Experience architecting evaluation, testing, or quality infrastructure at scale for AI/ML products.
• Familiarity with MLOps principles for model lifecycle management.
• Experience with VM orchestration, fleet management, or large-scale job scheduling systems.
• Knowledge of simulation and service virtualization techniques.
• Experience with observability platforms and defining SLOs for platform reliability.
• Experience with agentic AI systems and multi-step reasoning.
• Track record of leading cross-team architectural initiatives in organizations with 50+ engineers.

• Own the end-to-end technical vision and system architecture across the evaluation stack.
• Ensure architectural coherence and define interfaces between systems.
• Drive the technical roadmap for the evaluation platform.
• Embed with teams to understand their systems and make architectural decisions.
• Lead a review of existing evaluation tooling and infrastructure to identify gaps and opportunities.
• Represent the technical perspective in leadership discussions.
• Influence build-vs-integrate decisions and set standards for team efficiency.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.