Skip to content

Commit

Permalink
Refactor ClickHouse test code for better readability
Browse files Browse the repository at this point in the history
Signed-off-by: Marcel Coetzee <[email protected]>
  • Loading branch information
Pipboyguy committed May 28, 2024
1 parent c9c1394 commit 7a43618
Showing 1 changed file with 9 additions and 3 deletions.
12 changes: 9 additions & 3 deletions tests/load/clickhouse/test_clickhouse_gcs_s3_compatibility.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,15 @@ def test_clickhouse_gcs_s3_compatibility() -> None:
def dummy_data() -> Generator[Dict[str, int], None, None]:
yield {"field1": 1, "field2": 2}

gcp_bucket = filesystem(
GCS_BUCKET.replace("gs://", "s3://"), destination_name="filesystem_s3_gcs_comp"
)

gcp_bucket = filesystem(GCS_BUCKET.replace("gs://", "s3://"), destination_name="filesystem_s3_gcs_comp")

pipe = dlt.pipeline(pipeline_name="gcs_s3_compatibility", destination="clickhouse", staging=gcp_bucket, full_refresh=True, )
pipe = dlt.pipeline(
pipeline_name="gcs_s3_compatibility",
destination="clickhouse",
staging=gcp_bucket,
full_refresh=True,
)
pack = pipe.run([dummy_data])
assert_load_info(pack)

0 comments on commit 7a43618

Please sign in to comment.