The Staff Software Engineer, AI/ML role at Google focuses on developing advanced technologies that enhance how users interact with information. The position is part of the GenAI Data and Evaluation Platform team, which aims to provide infrastructure support for AI model evaluation. Engineers in this role will work on high-throughput serving infrastructure and collaborate with research teams to define requirements for next-generation AI models. This position offers opportunities for versatile engineers to tackle complex problems and drive innovation in AI development.

• Experience designing, building, and operating large-scale distributed systems with a focus on scalability, fault tolerance, and reliability.
• Experience in Machine Learning or AI infrastructure.
• Experience in software performance analysis and improvement, and High-Performance computer architectures.
• Experience designing software architecture for applications, including AI/ML systems.
• Experience with site reliability engineering, system architecture, and distributed systems.
• Experience building developer tools to improve development velocity, code quality, or code health.

• Lead the architectural design of high-throughput serving infrastructure for evaluation workflows.
• Design scalable systems to store, process, and serve massive datasets for model evaluation.
• Optimize the latency and resource efficiency of large-scale inference and evaluation pipelines.
• Collaborate with research teams to define infrastructure requirements for next-generation AI models.
• Establish technical roadmaps for data serving platforms supporting DeepMind's evaluation ecosystem.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.