From 9babbca92e6799f69515b7fc16dca406dc00426f Mon Sep 17 00:00:00 2001 From: T2938 Date: Mon, 4 Mar 2024 13:58:09 +0800 Subject: [PATCH 01/24] The sample code of transaction is missing ".build()" --- docs/txn-use.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/txn-use.md b/docs/txn-use.md index 3ddb0b2d4e42..3be260ac1dc4 100644 --- a/docs/txn-use.md +++ b/docs/txn-use.md @@ -85,7 +85,7 @@ To use Pulsar transaction API, complete the following steps. // Step 3: create a Pulsar client and enable transactions. .enableTransaction(true) .serviceUrl(jct.serviceUrl) - .build(); + .build() // Step 4: create three producers to produce messages to input and output topics. ProducerBuilder producerBuilder = client.newProducer(Schema.STRING); From 652c71d08f6fe79e4eda993e8f02fc46b4adb7b3 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Mon, 4 Mar 2024 14:31:42 +0800 Subject: [PATCH 02/24] Update admin-api-schemas.md --- docs/admin-api-schemas.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/admin-api-schemas.md b/docs/admin-api-schemas.md index d562e13a4ea2..c7539be53181 100644 --- a/docs/admin-api-schemas.md +++ b/docs/admin-api-schemas.md @@ -202,7 +202,7 @@ To get a specific version of a schema, you can use one of the following methods. Use the `get` subcommand. ```bash -pulsar-admin schemas get --version +pulsar-admin schemas get --version= ``` From 7a4ab54fd15a46da06c761e18e135b571d8133f3 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Mon, 4 Mar 2024 14:36:16 +0800 Subject: [PATCH 03/24] Update txn-use.md --- docs/txn-use.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/txn-use.md b/docs/txn-use.md index 3be260ac1dc4..3ddb0b2d4e42 100644 --- a/docs/txn-use.md +++ b/docs/txn-use.md @@ -85,7 +85,7 @@ To use Pulsar transaction API, complete the following steps. // Step 3: create a Pulsar client and enable transactions. .enableTransaction(true) .serviceUrl(jct.serviceUrl) - .build() + .build(); // Step 4: create three producers to produce messages to input and output topics. ProducerBuilder producerBuilder = client.newProducer(Schema.STRING); From 9d4dfbd98b8e9b318279259b58a15857852611c9 Mon Sep 17 00:00:00 2001 From: T2938 Date: Mon, 11 Mar 2024 10:37:19 +0800 Subject: [PATCH 04/24] Add the opration steps of RabbitMQ source connector. --- docs/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.10.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.11.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.8.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.9.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-3.0.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-3.1.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-3.2.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ 8 files changed, 808 insertions(+) diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index 65732703b6f5..73d19b1b1fc5 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index d6eab9429d72..e94b00e848c5 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.11.x/io-rabbitmq-source.md b/versioned_docs/version-2.11.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-2.11.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.11.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.8.x/io-rabbitmq-source.md b/versioned_docs/version-2.8.x/io-rabbitmq-source.md index 37f0718e4e18..40813fce1ffb 100644 --- a/versioned_docs/version-2.8.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.8.x/io-rabbitmq-source.md @@ -83,3 +83,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.9.x/io-rabbitmq-source.md b/versioned_docs/version-2.9.x/io-rabbitmq-source.md index 37f0718e4e18..40813fce1ffb 100644 --- a/versioned_docs/version-2.9.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.9.x/io-rabbitmq-source.md @@ -83,3 +83,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-3.0.x/io-rabbitmq-source.md b/versioned_docs/version-3.0.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-3.0.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.0.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-3.1.x/io-rabbitmq-source.md b/versioned_docs/version-3.1.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-3.1.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.1.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` From 126b50a56700dc4b48a729819f2b45c4ec2188fb Mon Sep 17 00:00:00 2001 From: T2938 Date: Mon, 11 Mar 2024 11:49:51 +0800 Subject: [PATCH 05/24] Add the operation steps of RabbitMQ source connector. --- docs/admin-api-schemas.md | 2 +- docs/io-rabbitmq-source.md | 101 ------------------ .../version-2.10.x/io-rabbitmq-source.md | 101 ------------------ .../version-2.11.x/io-rabbitmq-source.md | 101 ------------------ .../version-2.8.x/io-rabbitmq-source.md | 101 ------------------ .../version-2.9.x/io-rabbitmq-source.md | 101 ------------------ .../version-3.0.x/io-rabbitmq-source.md | 101 ------------------ .../version-3.1.x/io-rabbitmq-source.md | 101 ------------------ .../version-3.2.x/io-rabbitmq-source.md | 101 ------------------ 9 files changed, 1 insertion(+), 809 deletions(-) diff --git a/docs/admin-api-schemas.md b/docs/admin-api-schemas.md index c7539be53181..d562e13a4ea2 100644 --- a/docs/admin-api-schemas.md +++ b/docs/admin-api-schemas.md @@ -202,7 +202,7 @@ To get a specific version of a schema, you can use one of the following methods. Use the `get` subcommand. ```bash -pulsar-admin schemas get --version= +pulsar-admin schemas get --version ``` diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index 73d19b1b1fc5..65732703b6f5 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index e94b00e848c5..d6eab9429d72 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.11.x/io-rabbitmq-source.md b/versioned_docs/version-2.11.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-2.11.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.11.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.8.x/io-rabbitmq-source.md b/versioned_docs/version-2.8.x/io-rabbitmq-source.md index 40813fce1ffb..37f0718e4e18 100644 --- a/versioned_docs/version-2.8.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.8.x/io-rabbitmq-source.md @@ -83,104 +83,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.9.x/io-rabbitmq-source.md b/versioned_docs/version-2.9.x/io-rabbitmq-source.md index 40813fce1ffb..37f0718e4e18 100644 --- a/versioned_docs/version-2.9.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.9.x/io-rabbitmq-source.md @@ -83,104 +83,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-3.0.x/io-rabbitmq-source.md b/versioned_docs/version-3.0.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-3.0.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.0.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-3.1.x/io-rabbitmq-source.md b/versioned_docs/version-3.1.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-3.1.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.1.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` From d492cb7bbb7bc7c4e034f260cd5ecc0f7846d92d Mon Sep 17 00:00:00 2001 From: T2938 Date: Mon, 11 Mar 2024 12:43:04 +0800 Subject: [PATCH 06/24] Add the operation steps of RabbitMQ source connector. --- docs/admin-api-schemas.md | 2 +- docs/io-rabbitmq-source.md | 101 ------------------ .../version-2.10.x/io-rabbitmq-source.md | 101 ------------------ .../version-2.11.x/io-rabbitmq-source.md | 101 ------------------ .../version-2.8.x/io-rabbitmq-source.md | 101 ------------------ .../version-2.9.x/io-rabbitmq-source.md | 101 ------------------ .../version-3.0.x/io-rabbitmq-source.md | 101 ------------------ .../version-3.1.x/io-rabbitmq-source.md | 101 ------------------ .../version-3.2.x/io-rabbitmq-source.md | 101 ------------------ 9 files changed, 1 insertion(+), 809 deletions(-) diff --git a/docs/admin-api-schemas.md b/docs/admin-api-schemas.md index c7539be53181..d562e13a4ea2 100644 --- a/docs/admin-api-schemas.md +++ b/docs/admin-api-schemas.md @@ -202,7 +202,7 @@ To get a specific version of a schema, you can use one of the following methods. Use the `get` subcommand. ```bash -pulsar-admin schemas get --version= +pulsar-admin schemas get --version ``` diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index 73d19b1b1fc5..65732703b6f5 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index e94b00e848c5..d6eab9429d72 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.11.x/io-rabbitmq-source.md b/versioned_docs/version-2.11.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-2.11.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.11.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.8.x/io-rabbitmq-source.md b/versioned_docs/version-2.8.x/io-rabbitmq-source.md index 40813fce1ffb..37f0718e4e18 100644 --- a/versioned_docs/version-2.8.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.8.x/io-rabbitmq-source.md @@ -83,104 +83,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-2.9.x/io-rabbitmq-source.md b/versioned_docs/version-2.9.x/io-rabbitmq-source.md index 40813fce1ffb..37f0718e4e18 100644 --- a/versioned_docs/version-2.9.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.9.x/io-rabbitmq-source.md @@ -83,104 +83,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-3.0.x/io-rabbitmq-source.md b/versioned_docs/version-3.0.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-3.0.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.0.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-3.1.x/io-rabbitmq-source.md b/versioned_docs/version-3.1.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-3.1.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.1.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 702c37b654db..65732703b6f5 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -85,104 +85,3 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` -## Usage - - -### Standalone mode - -This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. - -#### Prerequisites - -- There is a RabbitMQ server with some history messages in the queue. - -#### Steps - -1. Get a Pulsar package and start Pulsar in standalone mode. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz - tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz - cd apache-pulsar-@pulsar:version@ - bin/pulsar standalone - ``` - -2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. - - ```bash - wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar - cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors - ``` - -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. - - ```bash - ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default - ``` - - -4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. - ```yaml - configs: - host: "localhost" - port: 5672 - virtualHost: "/" - username: "guest" - password: "guest" - queueName: "test-queue" - connectionName: "test-connection" - requestedChannelMax: 0 - requestedFrameMax: 0 - connectionTimeout: 60000 - handshakeTimeout: 10000 - requestedHeartbeat: 60 - prefetchCount: 0 - prefetchGlobal: "false" - passive: "false" - ``` - - Copy the configuration file to Pulsar‘s conf directory. - ```bash - cp rabbitmq-source-queue-name.yaml ./conf - ``` - -5. Open a new terminal window and start the connector in local run mode. - - ```bash - ./bin/pulsar-admin source localrun \ - --source-config-file conf/rabbitmq-source-queue-name.yaml \ - --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ - --name rabbitmq-source \ - --destination-topic-name pulsar-rabbitmq-test-topic \ - --broker-service-url pulsar://{ip}:{port} - ``` - -6. Open a new terminal window and check the topic is created automatically. - - ```bash - ./bin/pulsar-admin topics list public/default \ - ``` - - This topic is created automatically as follows: - - ```bash - persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 - ``` - -7. Consume this topic. - - ```bash - ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest - ``` - - The following information appears on the consumer terminal window. - - ```bash - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 - ----- got message ----- - key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 - - ... ... - - ``` From c3c63f1d5a3683648ef55f43db61e0169e77e621 Mon Sep 17 00:00:00 2001 From: T2938 Date: Mon, 11 Mar 2024 12:53:33 +0800 Subject: [PATCH 07/24] Add the operation steps of RabbitMQ source connector. --- docs/admin-api-schemas.md | 2 +- docs/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.10.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.11.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.8.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-2.9.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-3.0.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-3.1.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ .../version-3.2.x/io-rabbitmq-source.md | 101 ++++++++++++++++++ 9 files changed, 809 insertions(+), 1 deletion(-) diff --git a/docs/admin-api-schemas.md b/docs/admin-api-schemas.md index d562e13a4ea2..c7539be53181 100644 --- a/docs/admin-api-schemas.md +++ b/docs/admin-api-schemas.md @@ -202,7 +202,7 @@ To get a specific version of a schema, you can use one of the following methods. Use the `get` subcommand. ```bash -pulsar-admin schemas get --version +pulsar-admin schemas get --version= ``` diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index 65732703b6f5..73d19b1b1fc5 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index d6eab9429d72..e94b00e848c5 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.11.x/io-rabbitmq-source.md b/versioned_docs/version-2.11.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-2.11.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.11.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.8.x/io-rabbitmq-source.md b/versioned_docs/version-2.8.x/io-rabbitmq-source.md index 37f0718e4e18..40813fce1ffb 100644 --- a/versioned_docs/version-2.8.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.8.x/io-rabbitmq-source.md @@ -83,3 +83,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-2.9.x/io-rabbitmq-source.md b/versioned_docs/version-2.9.x/io-rabbitmq-source.md index 37f0718e4e18..40813fce1ffb 100644 --- a/versioned_docs/version-2.9.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.9.x/io-rabbitmq-source.md @@ -83,3 +83,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-3.0.x/io-rabbitmq-source.md b/versioned_docs/version-3.0.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-3.0.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.0.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-3.1.x/io-rabbitmq-source.md b/versioned_docs/version-3.1.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-3.1.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.1.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 65732703b6f5..702c37b654db 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -85,3 +85,104 @@ Before using the RabbitMQ source connector, you need to create a configuration f passive: "false" ``` +## Usage + + +### Standalone mode + +This example describes how to use the RabbitMQ source connector to feed data from RabbitMQ and write data to Pulsar topics in the standalone mode. + +#### Prerequisites + +- There is a RabbitMQ server with some history messages in the queue. + +#### Steps + +1. Get a Pulsar package and start Pulsar in standalone mode. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/apache-pulsar-@pulsar:version@-bin.tar.gz + tar xvfz apache-pulsar-@pulsar:version@-bin.tar.gz + cd apache-pulsar-@pulsar:version@ + bin/pulsar standalone + ``` + +2. Download the [nar package](https://archive.apache.org/dist/pulsar/) corresponding to Pulsar's version and copy the following file to Pulsar's directory. + + ```bash + wget https://archive.apache.org/dist/pulsar/pulsar-@pulsar:version@/connectors/pulsar-io-rabbitmq-@pulsar:version@.nar + cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors + ``` + +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. + + ```bash + ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default + ``` + + +4. Prepare a configuration file with name is _rabbitmq-source-queue-name.yaml_. + ```yaml + configs: + host: "localhost" + port: 5672 + virtualHost: "/" + username: "guest" + password: "guest" + queueName: "test-queue" + connectionName: "test-connection" + requestedChannelMax: 0 + requestedFrameMax: 0 + connectionTimeout: 60000 + handshakeTimeout: 10000 + requestedHeartbeat: 60 + prefetchCount: 0 + prefetchGlobal: "false" + passive: "false" + ``` + + Copy the configuration file to Pulsar‘s conf directory. + ```bash + cp rabbitmq-source-queue-name.yaml ./conf + ``` + +5. Open a new terminal window and start the connector in local run mode. + + ```bash + ./bin/pulsar-admin source localrun \ + --source-config-file conf/rabbitmq-source-queue-name.yaml \ + --archive connectors/pulsar-io-rabbitmq-@pulsar:version@.nar \ + --name rabbitmq-source \ + --destination-topic-name pulsar-rabbitmq-test-topic \ + --broker-service-url pulsar://{ip}:{port} + ``` + +6. Open a new terminal window and check the topic is created automatically. + + ```bash + ./bin/pulsar-admin topics list public/default \ + ``` + + This topic is created automatically as follows: + + ```bash + persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 + ``` + +7. Consume this topic. + + ```bash + ./bin/pulsar-client consume persistent://public/default/pulsar-rabbitmq-test-topic-partition-0 -s s1 -n 0 -p Earliest + ``` + + The following information appears on the consumer terminal window. + + ```bash + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 0 + ----- got message ----- + key:[quick.orange.pulsar], properties:[], content:message-topic-O(range) 1 + + ... ... + + ``` From 1a2702ae83d347e3b370d851ab3397227be0c5a3 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Mon, 11 Mar 2024 12:53:32 +0800 Subject: [PATCH 08/24] Update admin-api-schemas.md --- docs/admin-api-schemas.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/admin-api-schemas.md b/docs/admin-api-schemas.md index c7539be53181..d562e13a4ea2 100644 --- a/docs/admin-api-schemas.md +++ b/docs/admin-api-schemas.md @@ -202,7 +202,7 @@ To get a specific version of a schema, you can use one of the following methods. Use the `get` subcommand. ```bash -pulsar-admin schemas get --version= +pulsar-admin schemas get --version ``` From 4a8e9d57ed1a91e6c0f2fcbc3876327a03e13a92 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:16:37 +0800 Subject: [PATCH 09/24] Update io-rabbitmq-source.md --- docs/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index 73d19b1b1fc5..be8934a23383 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 74a648d3426b89a6d1a21207c9c0b1f33690cc07 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:17:19 +0800 Subject: [PATCH 10/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.10.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index e94b00e848c5..810465dfaa72 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From e271643a13a74bf139e69fb458e49efeeb1ca5c8 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:19:44 +0800 Subject: [PATCH 11/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.11.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.11.x/io-rabbitmq-source.md b/versioned_docs/version-2.11.x/io-rabbitmq-source.md index 702c37b654db..65845ce309cd 100644 --- a/versioned_docs/version-2.11.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.11.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From f0281bf96333cd9fa3655e3fc1abbc2409b0a5b5 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:20:20 +0800 Subject: [PATCH 12/24] Update io-rabbitmq-source.md --- docs/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index be8934a23383..eb7d85911822 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription been immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 5919ec7380f178549d0c8d48f0c2c0304e0f4b79 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:22:24 +0800 Subject: [PATCH 13/24] Update io-rabbitmq-source.md --- versioned_docs/version-3.2.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 702c37b654db..8059a04cb8a5 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have benn immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 72dc6746c3e840f9b3ed4c5304e9a4223717078c Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:25:46 +0800 Subject: [PATCH 14/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.10.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index 810465dfaa72..25c65dfe9554 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription been immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 81213c6dfe229f41f1a581095bddf83679aeab5c Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:26:39 +0800 Subject: [PATCH 15/24] Update io-rabbitmq-source.md --- versioned_docs/version-3.1.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-3.1.x/io-rabbitmq-source.md b/versioned_docs/version-3.1.x/io-rabbitmq-source.md index 702c37b654db..65845ce309cd 100644 --- a/versioned_docs/version-3.1.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.1.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 2dd4c0703934790b9fa381386b2bf0fbe9787ee7 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:27:09 +0800 Subject: [PATCH 16/24] Update io-rabbitmq-source.md --- versioned_docs/version-3.2.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 8059a04cb8a5..65845ce309cd 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have benn immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 077420b4c2cc02fbe379490249b8bc3357a1fc93 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:28:05 +0800 Subject: [PATCH 17/24] Update io-rabbitmq-source.md --- versioned_docs/version-3.0.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-3.0.x/io-rabbitmq-source.md b/versioned_docs/version-3.0.x/io-rabbitmq-source.md index 702c37b654db..65845ce309cd 100644 --- a/versioned_docs/version-3.0.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.0.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 6299fcef8e83539b0e7767542bd6d6f9741e8806 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:29:04 +0800 Subject: [PATCH 18/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.8.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.8.x/io-rabbitmq-source.md b/versioned_docs/version-2.8.x/io-rabbitmq-source.md index 40813fce1ffb..de28a06feaf9 100644 --- a/versioned_docs/version-2.8.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.8.x/io-rabbitmq-source.md @@ -112,7 +112,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From e5663b909d415599d9cc8fba9dc28ecd1e03d22f Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 09:30:05 +0800 Subject: [PATCH 19/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.9.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.9.x/io-rabbitmq-source.md b/versioned_docs/version-2.9.x/io-rabbitmq-source.md index 40813fce1ffb..de28a06feaf9 100644 --- a/versioned_docs/version-2.9.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.9.x/io-rabbitmq-source.md @@ -112,7 +112,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription ware immediately deleted. +3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From 9551955e811486e583daa3d7747dbcdff2b51788 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 15:54:46 +0800 Subject: [PATCH 20/24] Update docs/io-rabbitmq-source.md MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit very good！ Co-authored-by: Kiryl Valkovich 🛸 --- docs/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/io-rabbitmq-source.md b/docs/io-rabbitmq-source.md index eb7d85911822..284529ef6657 100644 --- a/docs/io-rabbitmq-source.md +++ b/docs/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. +3. Messages published to a topic lacking at least one durable subscription are automatically marked as ready for deletion by default. We can set a retention policy at the namespace level to prevent this. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From d31918bce477fb5b6592352b3bfc8bc1c152784a Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 15:56:00 +0800 Subject: [PATCH 21/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.10.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.10.x/io-rabbitmq-source.md b/versioned_docs/version-2.10.x/io-rabbitmq-source.md index 25c65dfe9554..70341e313230 100644 --- a/versioned_docs/version-2.10.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.10.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. +3. Messages published to a topic lacking at least one durable subscription are automatically marked as ready for deletion by default. We can set a retention policy at the namespace level to prevent this. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From ecb5fed17a7a4a7bdf3473e114718628749a1ff1 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 15:56:41 +0800 Subject: [PATCH 22/24] Update io-rabbitmq-source.md --- versioned_docs/version-3.2.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-3.2.x/io-rabbitmq-source.md b/versioned_docs/version-3.2.x/io-rabbitmq-source.md index 65845ce309cd..b926dcee5852 100644 --- a/versioned_docs/version-3.2.x/io-rabbitmq-source.md +++ b/versioned_docs/version-3.2.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. +3. Messages published to a topic lacking at least one durable subscription are automatically marked as ready for deletion by default. We can set a retention policy at the namespace level to prevent this. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From b2708e90db1d670e539257963ecb086bf57a2961 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 15:57:38 +0800 Subject: [PATCH 23/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.11.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.11.x/io-rabbitmq-source.md b/versioned_docs/version-2.11.x/io-rabbitmq-source.md index 65845ce309cd..b926dcee5852 100644 --- a/versioned_docs/version-2.11.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.11.x/io-rabbitmq-source.md @@ -114,7 +114,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. +3. Messages published to a topic lacking at least one durable subscription are automatically marked as ready for deletion by default. We can set a retention policy at the namespace level to prevent this. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default From dfc6f2c500ac217620d6e5768dc15b64278fd692 Mon Sep 17 00:00:00 2001 From: Yajun Zhao <92070379+zhaoyajun2009@users.noreply.github.com> Date: Tue, 12 Mar 2024 15:58:16 +0800 Subject: [PATCH 24/24] Update io-rabbitmq-source.md --- versioned_docs/version-2.8.x/io-rabbitmq-source.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/versioned_docs/version-2.8.x/io-rabbitmq-source.md b/versioned_docs/version-2.8.x/io-rabbitmq-source.md index de28a06feaf9..d26e4c71f456 100644 --- a/versioned_docs/version-2.8.x/io-rabbitmq-source.md +++ b/versioned_docs/version-2.8.x/io-rabbitmq-source.md @@ -112,7 +112,7 @@ This example describes how to use the RabbitMQ source connector to feed data fro cp pulsar-io-rabbitmq-@pulsar:version@.nar ./connectors ``` -3. Set the retention of the namespace, otherwise the messages into the Pulsar's topic which have not the subscription have been immediately deleted. +3. Messages published to a topic lacking at least one durable subscription are automatically marked as ready for deletion by default. We can set a retention policy at the namespace level to prevent this. ```bash ./bin/pulsar-admin namespaces set-retention -s 100M -t 3d public/default