The Staff Software Engineer, GPU Performance role at Google focuses on enhancing the performance of machine learning models through advanced GPU architectures. The position is part of the AI and Infrastructure team, which aims to deliver AI capabilities at scale and efficiency. The engineer will work on identifying performance bottlenecks and architecting transformative solutions. This role is crucial for shaping the future of AI and accelerated computing within Google.

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products.
• 3 years of experience with software design and architecture.
• Experience with modern GPU architectures and performance bottlenecks.
• Experience with low-level GPU programming and performance engineering techniques.

• Identify and maintain LLM training and serving benchmarks to identify performance opportunities.
• Engage with various teams to solve challenging ML model performance problems.
• Run architecture-level simulations on GPU designs and perform roofline analysis.
• Analyze performance and efficiency metrics to identify bottlenecks and design solutions.
• Run performance benchmarks on GPU hardware using internal and external tools.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.