Skip to content

Update Databricks and Azure DB doc to include ADBC driver #590

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jul 15, 2025
Merged

Update Databricks and Azure DB doc to include ADBC driver #590

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
9f2cab6
Update Databricks and Azure DB doc to include ADBC driver
emile-00 Jul 10, 2025
4a42f94
Update link in Azure DB doc
emile-00 Jul 11, 2025
3ccd829
Apply fixes
emile-00 Jul 11, 2025
956e5f9
fix link
emile-00 Jul 11, 2025
62589e2
Update Azure code cell
emile-00 Jul 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 24 additions & 0 deletions powerquery-docs/connectors/databricks-azure.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,9 @@ ms.subservice: connectors
| Products | Power BI (Semantic models)<br/>Power BI (Dataflows)<br/>Fabric (Dataflow Gen2) |
| Authentication Types Supported | Azure Active Directory<br/>Personal Access Token<br/>Username / Password |

> [!NOTE]
>The Azure Databricks connector for Power BI now supports the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/Databricks/readme.md) driver. This feature is available in preview. Learn more [here](#arrow-database-connectivity-driver-connector-implementation-preview).

## Capabilities supported

* Import
Expand Down Expand Up @@ -78,6 +81,27 @@ To connect to Databricks from Power Query Online, take the following steps:

:::image type="content" source="./media/databricksazure/pq-choose-data.png" alt-text="Image of Power Query navigator loading Databricks Cloud data to online app.":::

## Arrow Database Connectivity driver connector implementation (Preview)

You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/Databricks/readme.md) driver for the Azure Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend that you to upgrade to the latest version to try it out and [submit product feedback](/azure/databricks/resources/ideas).

To switch to the ADBC driver:

1. Open your desired dashboard in Power BI.
1. Select **Transform Data**.
1. Select **Advanced Editor** in the **Query** option section.
1. Specify `Implementation="2.0"` for ADBC.
```powerquery-m
let
Source = Databricks.Catalogs("adb-<workspace-id>.<random-number>.azuredatabricks.net", "/sql/1.0/warehouses/<sql-warehouse-id>",
[Catalog=null, Database=null, EnableAutomaticProxyDiscovery=null, Implementation="2.0"]),
powerbi_Database = Source{[Name="powerbi",Kind="Database"]}[Data],
default_Schema = powerbi_Database{[Name="default",Kind="Schema"]}[Data],
dashboard_data_Table = default_Schema{[Name="dashboard_data",Kind="Table"]}[Data]
in
dashboard_data_Table
```

## Limitations

* The Azure Databricks connector supports [web proxy](/power-bi/connect-data/desktop-troubleshooting-sign-in#using-default-system-credentials-for-web-proxy). However, automatic proxy settings defined in .pac files aren't supported.
Expand Down
24 changes: 24 additions & 0 deletions powerquery-docs/connectors/databricks.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,9 @@ ms.subservice: connectors
> [!NOTE]
>Some capabilities may be present in one product but not others due to deployment schedules and host-specific capabilities.

> [!NOTE]
>The Databricks connector for Power BI now supports the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/Databricks/readme.md) driver. This feature is available in preview. Learn more [here](#arrow-database-connectivity-driver-connector-implementation-preview).

## Prerequisites

This connector is only for use with a Databricks SQL Warehouse running on AWS and using OAuth. If you're using Azure Databricks, use the [Azure Databricks](databricks-azure.md) connector. If you aren't using OAuth with your Databricks SQL Warehouse (on AWS or GCP), use the [Azure Databricks](databricks-azure.md) connector too. Databricks Community Edition isn't supported.
Expand Down Expand Up @@ -84,3 +87,24 @@ To connect to Databricks from Power Query Online, take the following steps:
4. Once you successfully connect, the **Navigator** appears and displays the data available on the server. Select your data in the navigator. Then select **Next** to transform the data in Power Query.

:::image type="content" source="./media/databricks/pq-choose-data.png" alt-text="Image of Power Query navigator loading Databricks Cloud data to online app.":::

## Arrow Database Connectivity driver connector implementation (Preview)

You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/Databricks/readme.md) driver for the Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend that you to upgrade to the latest version to try it out and [submit product feedback](https://docs.databricks.com/aws/en/resources/ideas).

To switch to the ADBC driver:

1. Open your desired dashboard in Power BI.
1. Select **Transform Data**.
1. Select **Advanced Editor** in the **Query** option section.
1. Specify `Implementation="2.0"` for ADBC.
```powerquery-m
let
Source = DatabricksMultiCloud.Catalogs("<instance-name>.cloud.databricks.net", "/sql/1.0/warehouses/<sql-warehouse-id>",
[Catalog=null, Database=null, EnableAutomaticProxyDiscovery=null, Implementation="2.0"]),
powerbi_Database = Source{[Name="powerbi",Kind="Database"]}[Data],
default_Schema = powerbi_Database{[Name="default",Kind="Schema"]}[Data],
dashboard_data_Table = default_Schema{[Name="dashboard_data",Kind="Table"]}[Data]
in
dashboard_data_Table
```