As a software engineer on the Runtime team at Databricks, you will focus on building the next generation of distributed data storage and processing systems. This role involves developing solutions that outperform specialized SQL query engines while supporting diverse workloads, including ETL and data science. You will work on projects like Apache Spark, Delta Lake, and Delta Pipelines, contributing to the evolution of data infrastructure. The team is dedicated to solving technical challenges and delivering customer value through innovative data solutions.

• BS (or higher) in Computer Science, related technical field or equivalent practical experience.
• 5+ years of production level experience in either Java, Scala or C++.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems such as Apache Spark and Hadoop.
• Comfortable working towards a multi-year vision with incremental deliverables.

• Build next generation distributed data storage and processing systems.
• Develop reliable and high performance services for storing and accessing large amounts of data.
• Contribute to the development of the Delta Lake storage management system.
• Work on the Delta Pipelines project to simplify the orchestration of data engineering pipelines.
• Enhance the query optimizer and execution engine for improved performance.