TPC-DS Benchmark Result Reports

How Does Power BI / Direct Lake Perform & Scale on Microsoft Fabric

Benchmark Report 2024 - Cover

Using an industry-standard benchmark, this report tests Microsoft’s assertion that its Direct Lake architecture on Fabric is ideally suited for enabling Power BI to offer a direct query experience without the need for imports.

This comprehensive study tests the capabilities of Power BI’s new Direct Lake connection to Microsoft’s OneLake platform against three different database sizes, ranging from 100 gigabytes to 10 terabytes, under light to heavy user concurrency. As part of the analysis, analysts compare the test results of Power BI/Direct Lake against alternative approaches, AtScale on Databricks and Snowflake.

The benchmarking study documents the following key insights:

  1. Direct Lake serves as a “lazy load” Import Mode alternative with all the same drawbacks and limitations as Import Mode
  2. Direct Lake is fast on very small data but stumbles with larger data and higher user concurrency
  3. Upon a data or model refresh, Direct Lake creates a substantial “cold cache” performance hit
  4. Power BI Web is missing critical modeling features and is poorly suited for multi-user collaboration
  5. Fabric Lakehouse is not suitable for serving as a general purpose Lakehouse due to its lack of basic data management features

>> Download the report for Databricks.

>> Download the report for Snowflake.

AtScale Developer Edition