You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The search in previously-selected LocalDocs collections is still performed when no collectiins are selected anymore.
This is proved not by the resulting reply, but by
the message ,"searching localdocs"
processor-memory occupancy
The same happens at the first and second prompt after de-selecting the previously selected collections. It also happens on several subsequent prompts, until I couldn't be bothered to find out in which circumstances it would stop (check, uncheck, 1 collection or more, the order of these ops, that's the job of testers, if any that is.)
However, the replies refer knowledge that does not exist in those collections; even if this is somehow expected - the models will try and answer regardless of info from RAG, lacking a proper prompt (or System Prompt) syntax that would prevent it to do so - even so, is obvious that despite searching in those collections no info is retrieved from them.
This is an old problem, persisting since before v3.0.
It should have been solved by now, as it is related to critical functionality of the program, however despite users signaling it serms to have been put on the backburner and forgotten about, or ignored altogether - because after 4 5 updates it is still manifest.
Steps to Reproduce
Select (check) one 1 LD collection
ask the model something that exists in those LDs and it will reply with info from them
de-select (uncheck)the collection
ask the model anything
"searching localdocs" appears, and CPU/memory get busy like when the collection was selected
Expected Behavior
The search in LocalDocs does not have to be carried out if no collections are selected.
pseudocode,
if (num_selected_ldcols==0)
goto search_only_internalknowledge
Your Environment
GPT4All version: v3.5.3
Operating System: Win10 b19042
Chat model used (if applicable): Nous Hermes 2 Mistral DPO, and others
The text was updated successfully, but these errors were encountered:
SINAPSA-IC
changed the title
GPR4all v3.5.3 - A search in LocalDocs is carried out with no collections selected
GPT4All v3.5.3 - A search in LocalDocs is carried out with no collections selected
Dec 17, 2024
But can investigate, as 1) this was signaled way back in versions prior to 3.0 and now I'm seeing it in 3.5.3 and 2) relates to critical functionality. Something surely can be done to investigate, like, hooking the text on that label to a variabile and check if its text does indeed contain "searching localdocs..." when no collections are selected. And that^ video is moving so fast, I cannot discern anythinng, because there's that Light color scheme that burns the eyes along with small thin text for reduced contrast.
Perish the thought that the program moving that fast does not in fact leave the user enough time to actually read what's written on that label, even moreso when the files in the collection are only a few and all smallish. If it happens here, it surely is happening elsewhere, at other users. Ah yes, more importantly - this issue is old, has it been solved? Didn't see the Yes, it was known and has been solved, but then again, it must've escaped me.
As someone else here said in another Context, also aimed at improving the program but hey, that^ video amounts to gaslighting, but nevertheless the problem is really there. At least, out of curiosity to reproduce-investigate the issue, the video could be slowed down to, like, quarter speed, to be able to read those 2 words which Do appear as I explained.
And another thing - testing (if any at all) should be done on "consumer-grade hardware", not on industrial-grade rigs which are Not the target as the program is advertised.
Bug Report
The search in previously-selected LocalDocs collections is still performed when no collectiins are selected anymore.
However, the replies refer knowledge that does not exist in those collections; even if this is somehow expected - the models will try and answer regardless of info from RAG, lacking a proper prompt (or System Prompt) syntax that would prevent it to do so - even so, is obvious that despite searching in those collections no info is retrieved from them.
This is an old problem, persisting since before v3.0.
It should have been solved by now, as it is related to critical functionality of the program, however despite users signaling it serms to have been put on the backburner and forgotten about, or ignored altogether - because after 4 5 updates it is still manifest.
Steps to Reproduce
Expected Behavior
The search in LocalDocs does not have to be carried out if no collections are selected.
pseudocode,
if (num_selected_ldcols==0)
goto search_only_internalknowledge
Your Environment
The text was updated successfully, but these errors were encountered: