The Staff Software Engineer for Model as a Service at Google will focus on developing infrastructure to support the deployment and management of large generative AI models. This role involves collaborating with various teams to optimize model serving techniques and enhance the onboarding process for both open and closed source models. The engineer will be responsible for building a platform that allows partners to manage their services effectively on Google Cloud. This position requires a blend of technical expertise and leadership skills to drive projects that are critical to Google's AI initiatives.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products.
• 3 years of experience with software design and architecture.
• 5 years of experience with ML design and ML infrastructure.
• Experience integrating generative AI tools or LLM interfaces into workflows.
• Experience with Kubernetes, C++, and Go programming.

• Build infrastructure for model creators to generate business with their models.
• Build a platform for partners to manage their services on Vertex.
• Work with sister teams to bring optimized models and serving techniques.
• Build infrastructure for efficiently onboarding open and closed source models to Google Cloud.
• Scale and maintain existing Model-as-a-Service deployments.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.