The Software Engineer role at Google focuses on enhancing the LLM serving stack, with an emphasis on performance, scalability, and resource efficiency. The position is part of the GDC AI Models and Performance team, which aims to optimize AI infrastructure and improve GPU utilization. Engineers will work on innovative projects that involve system-level design and performance profiling. This role offers the opportunity to contribute to cutting-edge technology that impacts how Google's advanced Large Language Models operate.

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products.
• 3 years of experience with software design and architecture.
• 5 years of experience with ML design and ML infrastructure.

• Design, develop, and implement enhancements to the LLM serving stack.
• Contribute to the design and implementation of advanced serving architectures.
• Build and maintain infrastructure and tooling for performance analysis.
• Identify and address performance bottlenecks across the stack.
• Collaborate with research, engineering, and SRE teams to optimize LLMs.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.