The Staff Software Engineer, AI/ML Performance role at Google focuses on optimizing performance for AI/ML training and serving workloads, particularly with Cloud TPUs. The position is part of a team that drives cutting-edge performance enhancements and collaborates with various partner teams to achieve state-of-the-art results. Engineers in this role will leverage their expertise in software design and architecture to manage project priorities and deliverables. This position offers the opportunity to work on innovative technologies that impact billions of users worldwide.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

• Identify and maintain ML training and serving benchmarks.
• Achieve state-of-the-art performance for customer launches and competitive benchmark submissions.
• Use benchmarks to identify performance opportunities and drive optimizations in collaboration with partner teams.
• Participate in algorithmic innovation by exploiting new TPU hardware features.
• Co-design models that are TPU-friendly to showcase model quality at performance levels typical of OSS models designed on GPUs.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.