Skip to content

Commit

Permalink
[fix][doc] Highlights that Pulsar clients can seamlessly access data …
Browse files Browse the repository at this point in the history
…in offloaded ledgers. (#810)

* [fix][doc] tiered-storage doc: emphasizes that Pulsar clients can still transparently read the data in the offloaded ledgers.

* remove reference to Pulsar SQL from tiered-storage-overview.md

* fix double dot issue
  • Loading branch information
jak78 authored Mar 2, 2024
1 parent 5cc9d89 commit a69f0b8
Show file tree
Hide file tree
Showing 5 changed files with 7 additions and 7 deletions.
4 changes: 2 additions & 2 deletions docs/tiered-storage-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,6 @@ Tiered storage works as follows:

5. Moreover, you can trigger the offloading operation manually (via REST API or CLI) or automatically (via CLI).

6. After offloading ledgers to long-term storage, you can still query data in the offloaded ledgers with Pulsar SQL.
6. After transferring ledgers to long-term storage, the messages within these ledgers remain accessible to Pulsar consumers and readers, ensuring transparency in data retrieval.

For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).
For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).
2 changes: 1 addition & 1 deletion versioned_docs/version-2.11.x/tiered-storage-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,6 @@ Data written to BookKeeper is replicated to 3 physical machines by default. Howe

Before offloading ledgers to long-term storage, you need to configure buckets, credentials, and other properties for the cloud storage service. Additionally, Pulsar uses multi-part objects to upload the segment data and brokers may crash while uploading the data. It is recommended that you add a life cycle rule for your bucket to expire incomplete multi-part upload after a day or two days to avoid getting charged for incomplete uploads. Moreover, you can trigger the offloading operation manually (via REST API or CLI) or automatically (via CLI).

After offloading ledgers to long-term storage, you can still query data in the offloaded ledgers with Pulsar SQL.
After transferring ledgers to long-term storage, the messages within these ledgers remain accessible to Pulsar consumers and readers, ensuring transparency in data retrieval. Additionally, you can query data in the offloaded ledgers using Pulsar SQL.

For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).
2 changes: 1 addition & 1 deletion versioned_docs/version-3.0.x/tiered-storage-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,6 @@ Data written to BookKeeper is replicated to 3 physical machines by default. Howe

Before offloading ledgers to long-term storage, you need to configure buckets, credentials, and other properties for the cloud storage service. Additionally, Pulsar uses multi-part objects to upload the segment data and brokers may crash while uploading the data. It is recommended that you add a life cycle rule for your bucket to expire incomplete multi-part upload after a day or two days to avoid getting charged for incomplete uploads. Moreover, you can trigger the offloading operation manually (via REST API or CLI) or automatically (via CLI).

After offloading ledgers to long-term storage, you can still query data in the offloaded ledgers with Pulsar SQL.
After transferring ledgers to long-term storage, the messages within these ledgers remain accessible to Pulsar consumers and readers, ensuring transparency in data retrieval. Additionally, you can query data in the offloaded ledgers using Pulsar SQL.

For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).
2 changes: 1 addition & 1 deletion versioned_docs/version-3.1.x/tiered-storage-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,6 @@ Data written to BookKeeper is replicated to 3 physical machines by default. Howe

Before offloading ledgers to long-term storage, you need to configure buckets, credentials, and other properties for the cloud storage service. Additionally, Pulsar uses multi-part objects to upload the segment data and brokers may crash while uploading the data. It is recommended that you add a life cycle rule for your bucket to expire incomplete multi-part upload after a day or two days to avoid getting charged for incomplete uploads. Moreover, you can trigger the offloading operation manually (via REST API or CLI) or automatically (via CLI).

After offloading ledgers to long-term storage, you can still query data in the offloaded ledgers with Pulsar SQL.
After transferring ledgers to long-term storage, the messages within these ledgers remain accessible to Pulsar consumers and readers, ensuring transparency in data retrieval. Additionally, you can query data in the offloaded ledgers using Pulsar SQL.

For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).
4 changes: 2 additions & 2 deletions versioned_docs/version-3.2.x/tiered-storage-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,6 @@ Tiered storage works as follows:

5. Moreover, you can trigger the offloading operation manually (via REST API or CLI) or automatically (via CLI).

6. After offloading ledgers to long-term storage, you can still query data in the offloaded ledgers with Pulsar SQL.
6. After transferring ledgers to long-term storage, the messages within these ledgers remain accessible to Pulsar consumers and readers, ensuring transparency in data retrieval.

For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).
For more information about tiered storage for Pulsar topics, see [PIP-17](https://github.com/apache/pulsar/wiki/PIP-17:-Tiered-storage-for-Pulsar-topics) and [offload metrics](reference-metrics.md#offload-metrics).

0 comments on commit a69f0b8

Please sign in to comment.