Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Invalid mount config path does not exist .../configs/flags.yml #22144

Closed
marcosmarxm opened this issue Jan 31, 2023 · 4 comments · Fixed by #22158 or #22160
Closed

Invalid mount config path does not exist .../configs/flags.yml #22144

marcosmarxm opened this issue Jan 31, 2023 · 4 comments · Fixed by #22158 or #22160
Labels
area/platform issues related to the platform needs-triage team/platform-enablement type/bug Something isn't working

Comments

@marcosmarxm
Copy link
Member

Environment

  • Airbyte version: 0.40.32
  • OS Version / Instance: macOS
  • Deployment: Docker version 20.10.22, build 3a2c30b
  • Source Connector and version: NA
  • Destination Connector and version: NA
  • Step where error happened: Deploy / Sync job / Setup new connection / Update connector / Upgrade Airbyte

Current Behavior

Our current documentation to deploy Airbyte in Cloud Providers and to upgrade previous instances follow the instructions:

mkdir airbyte && cd airbyte
curl -sOO https://raw.githubusercontent.com/airbytehq/airbyte/master/{.env,docker-compose.yaml}
docker compose up -d

See example: https://docs.airbyte.com/deploying-airbyte/on-gcp-compute-engine#install-and-launch-airbyte

The PR #21569 introduced a dependency of file config/flags.yml which is not included in our docs.
Some users are reporting the problem when trying to deploy new instances or upgrade old ones.

Logs:

➜  test docker compose up -d
WARN[0000] The "NEW_SCHEDULER" variable is not set. Defaulting to a blank string.
WARN[0000] The "SECRET_PERSISTENCE" variable is not set. Defaulting to a blank string.
WARN[0000] The "JOB_ERROR_REPORTING_SENTRY_DSN" variable is not set. Defaulting to a blank string.
WARN[0000] The "WORKER_ENVIRONMENT" variable is not set. Defaulting to a blank string.
WARN[0000] The "GITHUB_STORE_BRANCH" variable is not set. Defaulting to a blank string.
WARN[0000] The "DEPLOYMENT_MODE" variable is not set. Defaulting to a blank string.
WARN[0000] The "LOG_CONNECTOR_MESSAGES" variable is not set. Defaulting to a blank string.
WARN[0000] The "SHOULD_RUN_NOTIFY_WORKFLOW" variable is not set. Defaulting to a blank string.
WARN[0000] The "SECRET_PERSISTENCE" variable is not set. Defaulting to a blank string.
WARN[0000] The "JOB_ERROR_REPORTING_SENTRY_DSN" variable is not set. Defaulting to a blank string.
WARN[0000] The "APPLY_FIELD_SELECTION" variable is not set. Defaulting to a blank string.
WARN[0000] The "FIELD_SELECTION_WORKSPACES" variable is not set. Defaulting to a blank string.
WARN[0000] The "DEPLOYMENT_MODE" variable is not set. Defaulting to a blank string.
WARN[0000] The "REMOTE_CONNECTOR_CATALOG_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "TEMPORAL_HISTORY_RETENTION_IN_DAYS" variable is not set. Defaulting to a blank string.
WARN[0000] The "UPDATE_DEFINITIONS_CRON_ENABLED" variable is not set. Defaulting to a blank string.
[+] Running 10/10
 ⠿ Network test_airbyte_internal               Created                     0.0s
 ⠿ Network test_airbyte_public                 Created                     0.0s
 ⠿ Network test_default                        C...                        0.0s
 ⠿ Volume "airbyte_workspace"                  Created                     0.0s
 ⠿ Volume "airbyte_db"                         Cr...                       0.0s
 ⠿ Volume "airbyte_data"                       Created                     0.0s
 ⠿ Container init                              Created                     0.1s
 ⠿ Container airbyte-temporal                  Created                     0.2s
 ⠿ Container airbyte-db                        C...                        0.1s
 ⠿ Container airbyte-bootloader                Created                     0.1s
 ⠋ Container airbyte-connector-builder-server  Creating                    0.0s
 ⠋ Container airbyte-cron                      Creating                    0.0s
 ⠋ Container airbyte-server                    Creating                    0.0s
 ⠋ Container airbyte-worker                    Creating                    0.0s
 ⠋ Container airbyte-webapp                    Creating                    0.0s
Error response from daemon: invalid mount config for type "bind": bind source path does not exist: /host_mnt/Users/marcosmarx/test/configs/flags.yml

Expected Behavior

Our docs should give instructions without problems.

Logs

Steps to Reproduce

  1. Follow instructions (one without pulling the entire project)
  2. Have Docker V2 installed
  3. docker compose up -d

Are you willing to submit a PR?

No

@marcosmarxm marcosmarxm added type/bug Something isn't working area/platform issues related to the platform needs-triage team/platform-enablement labels Jan 31, 2023
@marcosmarxm
Copy link
Member Author

@colesnodgrass fyi

@marcosmarxm
Copy link
Member Author

The recommendation to fix the issue is to wget/curl the file manually.

@colesnodgrass
Copy link
Member

@marcosmarxm this should be fixed by #22158 and the documentation was updated in #22160 to reflect this new file

@dan-r95
Copy link

dan-r95 commented May 27, 2024

For me, setting shared folders in docker-desktop was necessary
#33845 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/platform issues related to the platform needs-triage team/platform-enablement type/bug Something isn't working
Projects
None yet
3 participants