Skip to content

Releases: colpal/dataEng-container-tools

v0.6.4

16 Jul 14:52
289ad0f
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.6.3...v0.6.4

v0.6.3: JSON file read and Secret Parsing Stability Improvements

14 Feb 20:02
48f2c5d
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.6.2...v0.6.3

v0.6.2

19 May 21:07
0e5052f
Compare
Choose a tag to compare

Fixing bq module error handling

v0.6.1

13 May 21:14
82c3d6b
Compare
Choose a tag to compare

This release contains the following updates:

  • Addition of the BQ module to handle communication with Google BigQuery. There is no longer a connection to bigquery from the gcs module.
  • New implementation of secret handling. Secrets are now passed in as dictionaries in the format { secret_identifier : path_to_secret } and are accessed as object attributes. Ex.
sf_secret = secret_locations.SF 
  • New documentation regarding the new changes and updates
  • multiple bug fixes

v0.6.0

10 May 20:18
4672fe3
Compare
Choose a tag to compare
  • Updates encoding logic to force casting censored words as strings to avoid encoding issues.
  • Updates parsing logic for gcs uri; splits and and then concatenates protocol prefix and breadcrumbs to enable references files in buckets that don't have intermediate paths.
  • Updates command line arguments logic to separating clashing command line flags.

v0.5.9.3 Update Adding Argument

01 Mar 02:45
Compare
Choose a tag to compare

v0.5.9.1 shave args for adding action args

01 Mar 02:22
Compare
Choose a tag to compare

A release for adding actions arguments separately from other types.

v0.5.9.2 Build Distribution

01 Mar 02:43
50051af
Compare
Choose a tag to compare
Merge pull request #117 from colpal/feature/add_bq

Feature/add bq

v0.5.9 : Update get methods for uri's

06 Jan 16:42
a6c1505
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.5.8...v0.5.9

Fix for input and output uri methods

05 Nov 16:02
97def9b
Compare
Choose a tag to compare

This release revises the get_input_uris() and get_output_uris() to handle the the gcs prefix separately from the rest of the uri. This should ensure that the prefix is not alters when the uri is trimmed of invalid slash combination that may arise when referencing a pathless files in a gcs bucket. - (PR #105)