-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Iceberg]Support s3 as warehouse directory for hive file catalog #24328
base: master
Are you sure you want to change the base?
[Iceberg]Support s3 as warehouse directory for hive file catalog #24328
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the doc! Nit in the link formatting, everything else looks good.
@@ -265,6 +265,22 @@ Property Name Description | |||
Otherwise, it will be ignored. | |||
======================================================= ============================================================= ============ | |||
|
|||
Configure the `Amazon S3 <https://prestodb.io/docs/current/connector/hive.html##amazon-s3-configuration>`_ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Configure the `Amazon S3 <https://prestodb.io/docs/current/connector/hive.html##amazon-s3-configuration>`_ | |
Configure the `Amazon S3 <https://prestodb.io/docs/current/connector/hive.html#amazon-s3-configuration>`_ |
Link breaks because of ##
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
68edb1a
to
9728632
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! (docs)
Pull updated branch, new local doc build, looks good. Thank you!
9728632
to
5718f9b
Compare
Description
This PR enable iceberg connector to use S3 location as warehouse dir for Hive file catalog.
By configuring the s3 properties described in https://prestodb.io/docs/current/connector/hive.html#amazon-s3-configuration, we can specify a S3 location as the warehouse dir of Hive file catalog. This way, both metadata and data
of iceberg tables will be maintained on S3 storage.
An example configuration includes:
Motivation and Context
Support specifying a S3 location directly as warehouse dir for Iceberg with Hive file catalog
Impact
N/A
Test Plan
Ozone
andMinIO
)IcebergDistributedTestBase
on S3 storage provided by dockerized MinIOContributor checklist
Release Notes