The role involves working as a high-agency engineer on the Foundation Model Inference team at Databricks, focusing on building infrastructure for generative AI capabilities. This team is responsible for enabling customers to serve, scale, and optimize large language models with enterprise-grade reliability. The position requires collaboration with various teams to enhance the performance of AI workloads and improve user experiences. Candidates will have the opportunity to impact how developers and data scientists interact with AI on the Databricks platform.

• 8+ years of experience in backend or infrastructure engineering
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure
• Experience with real-time serving, ML infrastructure, or GPU orchestration
• Familiarity with service-oriented architecture, deployment pipelines, and system observability

• Build LLM infrastructure powering large-scale inference workloads for customers through partner models and self-hosted models.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on Databricks.