As a software engineer on the Runtime team at Databricks, you will focus on building the next generation of distributed data storage and processing systems. This role involves developing systems that outperform traditional SQL query engines while supporting diverse workloads. You will work on projects such as Apache Spark, Delta Lake, and Delta Pipelines, contributing to innovative solutions in data engineering. The team is dedicated to solving complex technical challenges and delivering impactful customer value.

• BS (or higher) in Computer Science, related technical field or equivalent practical experience.
• 8+ years of production level experience in either Java, Scala or C++.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems such as Apache Spark and Hadoop.
• Comfortable working towards a multi-year vision with incremental deliverables.

• Build next generation distributed data storage and processing systems.
• Develop reliable and high performance services for storing and accessing large amounts of data.
• Create a storage management system that combines the benefits of data lakes and data warehouses.
• Simplify the orchestration and operation of data engineering pipelines.
• Design and implement a fast, scalable, and robust query optimizer and execution engine.