The Engineering Leader will oversee the Spark™ Structured Streaming team at Databricks, focusing on developing advanced stream processing capabilities. This role involves enhancing the Spark™ Structured Streaming engine by implementing sophisticated features and improving performance. The leader will also be responsible for recruiting and upskilling top-tier talent while ensuring the team builds high-quality infrastructure services. The position requires collaboration with product management and direct engagement with customers to drive adoption across the Databricks product portfolio.

• 5+ years of experience in a related system, streaming, query processing, or big-data ecosystem.
• A passion for database systems, storage systems, distributed systems, language design, or performance optimization.
• Experience managing distributed teams is preferred.
• Ability to attract, hire, and coach engineers who meet the Databricks hiring standards.
• Comfortable working cross-functionally with product management and directly with customers.

• Lead a talented engineering team in developing and promoting the Spark™ Structured Streaming engine.
• Oversee the sustained recruitment of top-tier talent and upskill the team.
• Implement robust processes to execute product vision, strategy, and roadmap.
• Build high-quality software that is easy to operate.
• Drive Stream Processing adoption across the Databricks product portfolio.
• Manage technical debt and long-term technical architecture decisions.