vecdb after rebase #64
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
olegklimov
reviewed
Jan 17, 2024
olegklimov
reviewed
Jan 17, 2024
olegklimov
reviewed
Jan 17, 2024
| Ok(paths) | ||
| } | ||
|
|
||
| pub async fn file_watcher_task( |
There was a problem hiding this comment.
block_forever_call_vecdb_when_jsonl_changes
olegklimov
reviewed
Jan 17, 2024
initial vecdb framework comments compilable thread -> tokyo coroutine debug fixes rebase fixes rm extra formatting changes using new splitter cosmetic changes, finishing some stuff status handler forward vecsearch to completion scratchpads add protobuf-compiler to gh actions add protobuf-compiler to gh actions add protobuf-compiler to gh actions add protobuf-compiler to gh actions add protobuf-compiler to gh actions add dummy handlers add impl for JB lsp handlers ask CSV first for the project files, so making it much robust status unprocessed_files_count fix vectordb cache simple prompts for chat / completion add protobuf build step add protobuf build step add protobuf build step add protobuf build step add protobuf build step add protobuf build step add protobuf build step add protobuf build step add protobuf build step review fixes, getting rid of unwrap() as much as possible review fixes, rebase try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake try build protobuf via cmake fix compile errors add stats for records and small rework add cleanup thread rebase fixes add cmdline arg to enable vecdb augment messages on stack
fix WIP fixed deps! changes requested by @olegklimov simplified get_embedding_openai_style and get_embedding_hf_style: removed attempts removed hardcoded hf_url; fixed some naming restoring order in args & naming vecdb is now dynamically reloading implemented changes request from @olegklimov minor minor added endpoint_embeddings_style init changelist: * added additional tries to embedding requests' * added init folders as a vecdb's method. Calling from vecdb_background_reload and LSP::initialize changelist: * creating new database if emb_size if different * if emb_size is equal, deleting embeddings creating for another model changelist: * removed remove_where_old_model * creating dedicated db_dir using key (model_name, embedding_size) vecdb is reloading only if caps changes. It checks for it every 30s bugfix Changelist: * chat_rag_functions are filled within vecdb init; * vecdb is called only when @workspace command is present in the latest message
* removed tokio::spawn from get_embedding_openai_style and get_embedding_hf_style * added try_load_caps_quickly_if_not_present to vecdb_background_reload * added test search to vecdb_background_reload
fix bug with `add_from_cache`
major: added @ commands enhanced logic of update_indexed_file_paths changelist: * update_indexed_file_paths ran in a wrong place * changed proximity metric to jaro-winkler * added is_cmd_executable param * added command_completion_error macro * various added at-command-preview implemented file command preview big one comments, renames fatman deadlock fix implemented format requirements just cleaning... minor renames and TODOs minor improvements format fixes & minor * misc
* CommandCompletion API update: added top_n field * Command Completion works even if argument is empty
JegernOUTT
force-pushed
the
vecdb-new
branch
from
7fef371 to
5b8ffcb
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.