1272 Support ClickHouse GCS S3 compatibility mode in filesystem destination

[Pipboyguy]

Description

Updates the filesystem destination to support using the S3 implementation with GCS buckets that have S3 interoperability mode (HMAC keys) enabled.

Key changes:

• Update convert_storage_to_http_scheme utility function to properly handle GCS endpoints
• Modify ClickHouse load job to raise an exception if GCS bucket is used without providing S3 compatible credentials (access key ID and secret access key)
• Add test case to verify ClickHouse loading from GCS bucket using S3 compatibility mode
• Remove old gcs tests. These will be added back in when named destinations are supported in templated tests.

Related Issues

• Resolves HMAC keys aren't implemented in GcpCredentials #1181
• Fixes Make filesystem destination work with gcs in s3 compatibility mode #1272

[netlify]

✅ Deploy Preview for dlt-hub-docs ready!

Name	Link
🔨 Latest commit	9a58f8f
🔍 Latest deploy log	https://app.netlify.com/sites/dlt-hub-docs/deploys/66587cd5d6613a0008b05569
😎 Deploy Preview	https://deploy-preview-1423--dlt-hub-docs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[rudolfix]

code: LGTM!
@Pipboyguy do we have the right credentials in our CI so this test is really connecting to clickhouse?

@sh-rp you should review this

[sh-rp]

code: LGTM! @Pipboyguy do we have the right credentials in our CI so this test is really connecting to clickhouse?

Yeah I put those in yesterday. The question you were asking was wether it is really connecting to GCS, right?

[Pipboyguy]

code: LGTM! @Pipboyguy do we have the right credentials in our CI so this test is really connecting to clickhouse?

@sh-rp you should review this

@rudolfix We are indeed connecting to GCS with HMAC credentials and test passes