[Feature Request]: Show task_executor heartbeat

[yuzhichang]

Is there an existing issue for the same feature request?

• I have checked the existing issues.

Is your feature request related to a problem?

NA

Describe the feature you'd like

Executor reports a heartbeat to Valkey every 30s. The heartbeat content is {"boot_at": float_1, "now": float2, "done_tasks": int, "pending_tasks": int, "retried_tasks": int}.
There's a ZSET for each executor in Valkey. The key is TASKEXE-N where N is the number of the executor.

RAGFlow system page shows task executors' heartbeats in recent 30 minutes.
There's a time axis for each axis for an executor. Each heartbeat is displayed as a column.

• Column height is pending_tasks. Background color is green.
• There's an embedded column, the height is retryied_tasks, background color is red.

The heartbeat content is shown when mouse hover a heartbeat.

Describe implementation you've considered

No response

Documentation, adoption, use case

No response

Additional information

No response

[yuzhichang]

Sample heartbeats in Valkey:

zhichyu@iris:~/private/code/python$ valkey-cli -u valkey://default:infini_rag_flow@redis:6379/1
Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
redis:6379[1]> smembers TASKEXE
1) "task_consumer_0"
redis:6379[1]> zrange task_consumer_0 0 -1
 1) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:20:48.580970', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 2) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:21:18.583895', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 3) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:21:48.585444', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 4) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:22:18.587761', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 5) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:22:48.590608', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 6) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:23:18.592594', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 7) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:23:48.595702', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 8) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:24:18.599861', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
 9) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:24:48.604687', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
10) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:25:18.608154', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
11) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:25:48.613274', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
12) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:26:18.618148', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
13) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:26:48.623556', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
14) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:27:18.627162', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
15) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:27:48.630357', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
16) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:28:18.633624', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
17) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:28:48.637686', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
18) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:29:18.640907', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
19) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:29:48.645438', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
20) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:30:18.649122', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
21) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:30:48.654233', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
22) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:31:18.657827', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
23) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:31:48.661637', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
24) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:32:18.664328', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
25) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:32:48.668872', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
26) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:33:18.673734', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
27) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:33:48.677406', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
28) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:34:18.681090', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
29) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:34:48.685942', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
30) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:35:18.690033', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
31) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:35:48.693853', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
32) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:36:18.698129', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
33) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:36:48.702988', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
34) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:37:18.706545', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
35) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:37:48.711179', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
36) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:38:18.715058', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
37) "{'name': 'task_consumer_0', 'now': '2024-11-15T13:38:48.717720', 'boot_at': '2024-11-15T12:50:44.362819', 'done': 0, 'retry': 0, 'pending': 12, 'head_created_at': '2024-11-15T12:47:40.348000', 'head_detail': {'message': '{\"id\": \"be890850a30c11ef93c1f4a80deb0ad1\", \"doc_id\": \"bc8079f8a30c11efa2d2f4a80deb0ad1\", \"from_page\": 0, \"to_page\": 12, \"create_time\": 1731646060338, \"create_date\": \"2024-11-15 12:47:40\", \"update_time\": 1731646060338, \"update_date\": \"2024-11-15 12:47:40\"}'}}"
38) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:43:13.482633\", \"boot_at\": \"2024-11-15T13:43:13.480777\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
39) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:43:43.484337\", \"boot_at\": \"2024-11-15T13:43:13.480777\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
40) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:48:01.871212\", \"boot_at\": \"2024-11-15T13:48:01.869242\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
41) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:48:31.873068\", \"boot_at\": \"2024-11-15T13:48:01.869242\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
42) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:49:01.874300\", \"boot_at\": \"2024-11-15T13:48:01.869242\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
43) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:49:31.880527\", \"boot_at\": \"2024-11-15T13:48:01.869242\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
44) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:50:01.913416\", \"boot_at\": \"2024-11-15T13:48:01.869242\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
45) "{\"name\": \"task_consumer_0\", \"now\": \"2024-11-15T13:50:31.914734\", \"boot_at\": \"2024-11-15T13:48:01.869242\", \"done\": 0, \"retry\": 0, \"pending\": 12, \"head_created_at\": \"2024-11-15T12:47:40.348000\", \"head_detail\": {\"message\": \"{\\\"id\\\": \\\"be890850a30c11ef93c1f4a80deb0ad1\\\", \\\"doc_id\\\": \\\"bc8079f8a30c11efa2d2f4a80deb0ad1\\\", \\\"from_page\\\": 0, \\\"to_page\\\": 12, \\\"create_time\\\": 1731646060338, \\\"create_date\\\": \\\"2024-11-15 12:47:40\\\", \\\"update_time\\\": 1731646060338, \\\"update_date\\\": \\\"2024-11-15 12:47:40\\\"}\"}}"
redis:6379[1]>