Skip to content

Update Databricks and Azure DB doc to include ADBC driver #590

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

emile-00
Copy link
Contributor

Update Databricks and Azure Databricks docs to include how to switch to using ADBC driver

@prmerger-automator prmerger-automator bot added the do-not-merge Don't merge this yet label Jul 10, 2025
Copy link
Contributor

Learn Build status updates of commit 9f2cab6:

⚠️ Validation status: warnings

File Status Preview URL Details
powerquery-docs/connectors/databricks-azure.md ⚠️Warning Details
powerquery-docs/connectors/databricks.md ✅Succeeded

powerquery-docs/connectors/databricks-azure.md

  • Line 86, Column 333: [Warning: hard-coded-locale - See documentation] Link 'https://learn.microsoft.com/en-us/azure/databricks/resources/ideas' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
  • Line 86, Column 333: [Suggestion: docs-link-absolute - See documentation] Absolute link 'https://learn.microsoft.com/en-us/azure/databricks/resources/ideas' will be broken in isolated environments. Replace with a relative link.

For more details, please refer to the build report.

Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.

@v-dirichards
Copy link
Contributor

@emile-00 Thank you for your contribution. Would you take a moment to sign the Contributor License Agreement (CLA)? After the CLA is signed, someone can review your pull request. Thanks!

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@emile-00
Copy link
Contributor Author

@emile-00 please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.

@microsoft-github-policy-service agree [company="{your company}"]

Options:

  • (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
@microsoft-github-policy-service agree
  • (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

@microsoft-github-policy-service agree company="Databricks"

@v-dirichards
Copy link
Contributor

refreshing CLA status

Copy link
Contributor

Learn Build status updates of commit 9f2cab6:

⚠️ Validation status: warnings

File Status Preview URL Details
powerquery-docs/connectors/databricks-azure.md ⚠️Warning Details
powerquery-docs/connectors/databricks.md ✅Succeeded

powerquery-docs/connectors/databricks-azure.md

  • Line 86, Column 333: [Warning: hard-coded-locale - See documentation] Link 'https://learn.microsoft.com/en-us/azure/databricks/resources/ideas' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
  • Line 86, Column 333: [Suggestion: docs-link-absolute - See documentation] Absolute link 'https://learn.microsoft.com/en-us/azure/databricks/resources/ideas' will be broken in isolated environments. Replace with a relative link.

For more details, please refer to the build report.

Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.

@v-dirichards
Copy link
Contributor

@emile-00 Can you do it again keeping the brackets at the end, so that it's in this exact format: @microsoft-github-policy-service agree [company="{your company}"]

@v-dirichards
Copy link
Contributor

@DougKlopfenstein

Can you review the proposed changes?

Important: When the changes are ready for publication, adding a #sign-off comment is the best way to signal that the PR is ready for the review team to merge.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@emile-00
Copy link
Contributor Author

@microsoft-github-policy-service agree [company="{Databricks}"]

@emile-00
Copy link
Contributor Author

@emile-00 the command you issued was incorrect. Please try again.

Examples are:

@microsoft-github-policy-service agree

and

@microsoft-github-policy-service agree company="your company"

@microsoft-github-policy-service agree [company="{Databricks}"]

@emile-00
Copy link
Contributor Author

@microsoft-github-policy-service agree company="{Databricks}"

Copy link
Contributor

@emile-00 : Thanks for your contribution! The author(s) and reviewer(s) have been notified to review your proposed change.

Copy link
Contributor

Learn Build status updates of commit 4a42f94:

✅ Validation status: passed

File Status Preview URL Details
powerquery-docs/connectors/databricks-azure.md ✅Succeeded
powerquery-docs/connectors/databricks.md ✅Succeeded

For more details, please refer to the build report.

@@ -78,6 +81,27 @@ To connect to Databricks from Power Query Online, take the following steps:

:::image type="content" source="./media/databricksazure/pq-choose-data.png" alt-text="Image of Power Query navigator loading Databricks Cloud data to online app.":::

## Arrow Database Connectivity driver connector implementation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add "(Preview)" to the end of the heading.


You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver for the Azure Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend you to upgrade to the latest version to try it out and [submit product feedback](/azure/databricks/resources/ideas).

To switch to the ADBC driver, do the following:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You don't need the last part of this sentence. Instead, just say "To switch to the ADBC driver:"

To switch to the ADBC driver, do the following:

1. Open your desired dashboard in Power BI.
1. Click **Transform Data**.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Click" to "Select". This is a Microsoft style issue.


1. Open your desired dashboard in Power BI.
1. Click **Transform Data**.
1. Click **Advanced Editor** in the **Query** option section.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Click" to "Select".

@@ -84,3 +87,24 @@ To connect to Databricks from Power Query Online, take the following steps:
4. Once you successfully connect, the **Navigator** appears and displays the data available on the server. Select your data in the navigator. Then select **Next** to transform the data in Power Query.

:::image type="content" source="./media/databricks/pq-choose-data.png" alt-text="Image of Power Query navigator loading Databricks Cloud data to online app.":::

## Arrow Database Connectivity driver connector implementation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add "(Preview)" at the end of this heading.


## Arrow Database Connectivity driver connector implementation

You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver for the Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend you to upgrade to the latest version to try it out and [submit product feedback](https://docs.databricks.com/aws/en/resources/ideas).
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the second sentence, change "...we recommend you to upgrade..." to "...we recommend that you upgrade...".


You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver for the Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend you to upgrade to the latest version to try it out and [submit product feedback](https://docs.databricks.com/aws/en/resources/ideas).

To switch to the ADBC driver, do the following:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change to "To switch to the ADBC driver:".

To switch to the ADBC driver, do the following:

1. Open your desired dashboard in Power BI.
1. Click **Transform Data**.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Click" to "Select".


1. Open your desired dashboard in Power BI.
1. Click **Transform Data**.
1. Click **Advanced Editor** in the **Query** option section.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Click" to "Select".

@@ -22,6 +22,9 @@ ms.subservice: connectors
| Products | Power BI (Semantic models)<br/>Power BI (Dataflows)<br/>Fabric (Dataflow Gen2) |
| Authentication Types Supported | Azure Active Directory<br/>Personal Access Token<br/>Username / Password |

> [!NOTE]
>The Azure Databricks connector for Power BI now supports the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver. This feature is available in preview. Learn more [here](#arrow-database-connectivity-driver-connector-implementation).

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the wrong link. It should link to https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/Databricks/readme.md instead of the one for BigQuery.

@@ -78,6 +81,27 @@ To connect to Databricks from Power Query Online, take the following steps:

:::image type="content" source="./media/databricksazure/pq-choose-data.png" alt-text="Image of Power Query navigator loading Databricks Cloud data to online app.":::

## Arrow Database Connectivity driver connector implementation

You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver for the Azure Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend you to upgrade to the latest version to try it out and [submit product feedback](/azure/databricks/resources/ideas).

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same about the BigQuery link.

@@ -25,6 +25,9 @@ ms.subservice: connectors
> [!NOTE]
>Some capabilities may be present in one product but not others due to deployment schedules and host-specific capabilities.

> [!NOTE]
>The Databricks connector for Power BI now supports the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver. This feature is available in preview. Learn more [here](#arrow-database-connectivity-driver-connector-implementation).

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same with the link to BigQuery instead of Databricks.


## Arrow Database Connectivity driver connector implementation

You can use the [Arrow Database Connectivity (ADBC)](https://github.com/apache/arrow-adbc/blob/main/csharp/src/Drivers/BigQuery/readme.md) driver for the Databricks connector in Power BI. As we continue to enhance and add new capabilities to this connector, we recommend you to upgrade to the latest version to try it out and [submit product feedback](https://docs.databricks.com/aws/en/resources/ideas).
Copy link

@davidhcoe davidhcoe Jul 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same link issue

1. Specify `Implementation="2.0"` for ADBC.
```powerquery-m
let
Source = DatabricksMultiCloud.Catalogs("adb-<workspace-id>.<random-number>.azuredatabricks.net", "/sql/1.0/warehouses/<sql-warehouse-id>",
Copy link

@davidhcoe davidhcoe Jul 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't this be Databricks.Catalogs for Azure Databricks?

Copy link
Contributor

Learn Build status updates of commit 3ccd829:

⚠️ Validation status: warnings

File Status Preview URL Details
powerquery-docs/connectors/databricks-azure.md ⚠️Warning Details
powerquery-docs/connectors/databricks.md ⚠️Warning Details

powerquery-docs/connectors/databricks-azure.md

  • Line 26, Column 245: [Warning: bookmark-not-found - See documentation] Cannot find bookmark '#arrow-database-connectivity-driver-connector-implementation' in 'connectors/databricks-azure.md'.

powerquery-docs/connectors/databricks.md

  • Line 29, Column 239: [Warning: bookmark-not-found - See documentation] Cannot find bookmark '#arrow-database-connectivity-driver-connector-implementation' in 'connectors/databricks.md'.

For more details, please refer to the build report.

Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.

Copy link
Contributor

Learn Build status updates of commit 956e5f9:

✅ Validation status: passed

File Status Preview URL Details
powerquery-docs/connectors/databricks-azure.md ✅Succeeded
powerquery-docs/connectors/databricks.md ✅Succeeded

For more details, please refer to the build report.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants