The Senior Software Engineer, Infrastructure, Cloud AI role at Google focuses on designing, building, and operating the backend serving systems for the Vertex Live API product. This position is part of the Live API Infrastructure team, which aims to enhance reliability, latency, and scalability for high-QPS production workloads. The engineer will work closely with cross-functional teams to integrate new models and features while ensuring a robust user experience. This role also involves mentoring junior team members and shaping the technical direction of the team.

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience testing, maintaining, or launching software products.
• 1 year of experience with software design and architecture.
• 3 years of experience with developing large-scale infrastructure, distributed systems, or networks.

• Design, build, and operate core Vertex Live API serving infrastructure end-to-end.
• Integrate new Gemini Live models and features in partnership with cross-functional teams.
• Optimize high-QPS, low-latency streaming performance.
• Develop the Live API surface and support sidecar models for a consistent user experience.
• Participate in on-call rotations and lead incident responses.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.