Skip to content

feat: introduce BullMQ for job management of website sync #4263

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 21 commits into from

Conversation

I-Info
Copy link
Contributor

@I-Info I-Info commented Mar 21, 2025

  • Introduced BullMQ for job queue management
  • Added new dataset status 'waiting'
  • Updated dataset status handling logic
  • Added Redis configuration in .env.template
  • Updated translations for new status

Copy link
Contributor

gru-agent bot commented Mar 21, 2025

TestGru Assignment

Summary

Link CommitId Status Reason
Detail ebf4257 🔄 In Progress

Files

File Pull Request
projects/app/src/pages/api/core/dataset/update.ts 🔄 In Progress

Tip

You can @gru-agent and leave your feedback. TestGru will make adjustments based on your input

@c121914yu
Copy link
Collaborator

c121914yu commented Mar 21, 2025

🤖 Generated by deploy action

📦 Preview Image: ghcr.io/labring/fastgpt-pr:fb07db9a142e80a6858e6932b19af63304deff35

c121914yu and others added 13 commits March 21, 2025 17:18
* feat: custom dataset split sign

* feat: custom dataset split sign
* add external variable debug

* fix ui

* plugin variables
* fix: invite link

* feat: create invite link and copy it directly
…bring#4237)

* update queue

* feat: sync api collection will refresh title

* sync collection

* remove lock

* perf: invite link ux
* sync collection

* remove lock

* fix ts

* fix: ts
* feat: redirect url can be inner url (labring#4138)

* fix: update new user sync api (labring#4145)

* feat: post all params to backend (labring#4151)

* pref: sso getauthurl api (labring#4172)

* pref: sso getauthurl api

* pref: sso

* solve the rootorglist (labring#4234)

---------

Co-authored-by: gggaaallleee <[email protected]>
* fix variable sync & popover button height

* required
* feat: node prompt version

* fix

* delete unused code

* fix

* fix code
* sync collection

* remove lock

* update prompt version
* sync collection

* remove lock

* perf: ai proxy
* sync collection

* remove lock

* feat: chunk index independent config

* feat: add max chunksize to split chunk function

* remove log

* update doc

* remove

* remove log
I-Info added 5 commits March 21, 2025 17:54
- Introduced BullMQ for job queue management
- Added new dataset status 'waiting'
- Updated dataset status handling logic
- Added Redis configuration in .env.template
- Updated translations for new status
- Implemented graceful shutdown in `instrumentation.ts` to close all workers on SIGINT and SIGTERM signals
@c121914yu c121914yu changed the base branch from v4.9.2-dev to v4.9.3-dev March 25, 2025 03:41
Copy link
Contributor

gru-agent bot commented Mar 25, 2025

❌ Rebase test pr failed: Error: Pull request #4263 is not created by gru-agent[bot]

@c121914yu c121914yu deleted the branch labring:v4.9.3-dev March 27, 2025 09:20
@c121914yu c121914yu closed this Mar 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants