The Staff Software Engineer, ML Systems Co-Design role at Google focuses on developing next-generation technologies that enhance machine learning workloads and their performance on TPU hardware. The position is part of the MARC team, which operates at the intersection of ML workloads and TPU silicon roadmaps. The engineer will define strategies for optimizing open-source ML models to achieve TPU performance and will work closely with technical leadership across various teams. This role requires a blend of technical expertise and leadership to drive complex initiatives.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

• Deliver certified performance ladders 6 months pre-pilot as the definitive goals for pricing, capacity planning, and XLA/kernel optimization.
• Adapt emerging open-source models into TPU-native paired variants to prove asymmetric TPU superiority.
• Ingest and optimize multi-turn agentic workflows, reasoning loops, and prompt/decode disaggregated topologies ahead of silicon.
• Author high-signal reference implementations that guarantee reachability of pre-pilot goals under real-world compiler constraints.
• Partner with director and executive technical leadership across TPU Hardware, XLA Compiler, and Cloud AI Systems to steer multi-year roadmaps.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.