Skip to content
This repository has been archived by the owner on Jun 25, 2024. It is now read-only.

Uploading DBFS file, not appearing in filesystem. #180

Open
CharlesAbetz opened this issue Sep 12, 2021 · 0 comments
Open

Uploading DBFS file, not appearing in filesystem. #180

CharlesAbetz opened this issue Sep 12, 2021 · 0 comments

Comments

@CharlesAbetz
Copy link

CharlesAbetz commented Sep 12, 2021

Using the databricksDeployDBFSFilesTask in Azure DevOps which is essentially a wrapper for the Powershell script in this project.

In my diagnostic log of the pipeline run I get the below
##[debug]Pushing file C:\a_work\161\a\clusterBuild\Databricks\rstudio-install.sh to /databricks/rstudio/rstudio-install.sh
##[debug]POST https://australiasoutheast.azuredatabricks.net/api/2.0/dbfs/put with -1-byte payload
##[debug]received 3-byte response of content type application/json

So I believe everything is ok, however.

When I actually check the file system in Databricks, it isn't there?
ls -al /databricks/rstudio

drwxr-xr-x 2 root root 4096 Sep 10 06:49 ./
drwxr-xr-x 1 root root 4096 Sep 10 06:49 ../

This is stopping me automating a cluster provision.

What am I missing?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant