From Chaos to Choreography: Multi-Agent Orchestration Patterns That Actually Work — Sandipan Bhaumik
AI Engineer Europe 2026 · 26:29
Enterprise data, analytics and AI
Databricks provides a unified platform for enterprises to process data, run analytics and build AI applications. Data engineers use Lakeflow for batch and streaming pipelines, while Lakehouse provides data warehousing and Unity Catalog governs data and AI assets. Business users can ask Genie questions in natural language and receive summaries, tables and visualizations. Developers use Agent Bricks to build agents grounded in company data and Lakebase, its serverless Postgres database, to run transactional applications alongside analytics and AI workloads.
Founded in 2013, Databricks brought together Ali Ghodsi, Ion Stoica, Matei Zaharia, Patrick Wendell, Reynold Xin, Andy Konwinski and Arsalan Tavakoli-Shiraji. Ghodsi is CEO and Zaharia is CTO. Zaharia started Apache Spark at UC Berkeley in 2009, establishing the company's roots in distributed data processing. Its lakehouse research proposed combining warehouse analytics with machine learning over directly accessible open data formats. Delta Lake supplies ACID transactions and data versioning for data lakes, while MLflow manages machine learning workflows.
Databricks sells a managed commercial platform with consumption-based pricing measured in Databricks Units. In August 2026, the company reported that more than 20,000 organizations, including 70% of the Fortune 500, used its platform, and that its annualized revenue run rate exceeded $7 billion.
AI Engineer Europe 2026 · 26:29
AI Engineer Europe 2026 · 37:06
AI Engineer World's Fair 2025 · 19:12
Affiliations reflect their AIE appearances, not necessarily current employment.