Databricks

Databricks is a data and artificial intelligence company founded in 2013 and headquartered in San Francisco, with operations worldwide. Its Data Intelligence Platform combines the capabilities of a data warehouse and a data lake in a single lakehouse architecture, bringing together data engineering, data science and machine learning. The platform is used by more than 15,000 organisations, including over 60% of the Fortune 500.

The company's technical foundations lie in Apache Spark, the open source big data processing engine created by its founders at UC Berkeley. Databricks has contributed several further open source projects to the community, among them Delta Lake for reliable data lake storage, MLflow for the machine learning lifecycle, and Unity Catalog for data governance and cataloguing. Work spans data engineering, ETL and data pipelines, big data processing, machine learning, generative AI and open source software.

Databricks describes itself as a team of engineers and researchers with an academic lineage, and states a mission of making data and AI accessible to everyone rather than only to technical experts. The company has operated for more than a decade since its founding.