Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use Google Batch for full ETL runs #3211

Merged
merged 6 commits into from
Jan 29, 2024
Merged

Use Google Batch for full ETL runs #3211

merged 6 commits into from
Jan 29, 2024

Commits on Jan 29, 2024

  1. Create batch job on push to try-google-batch branch

    @jdangerx
    jdangerx committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    2c135ba View commit details
    Browse the repository at this point in the history

  2. Add debugging output for docker image.

    @jdangerx
    jdangerx committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    31a1bb7 View commit details
    Browse the repository at this point in the history

  3. Attempt to use in-container postgres

    @jdangerx
    jdangerx committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    69ec683 View commit details
    Browse the repository at this point in the history

  4. More time, less disk space

    @jdangerx
    jdangerx committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    672961e View commit details
    Browse the repository at this point in the history

  5. Terminate Postgres instance so container can exit.

    @jdangerx
    jdangerx committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    8a337f1 View commit details
    Browse the repository at this point in the history

  6. Update slack language

    @jdangerx
    jdangerx committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    13416cf View commit details
    Browse the repository at this point in the history