Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

r2ai list non existent models #56

Open
cryptax opened this issue Sep 20, 2024 · 3 comments
Open

r2ai list non existent models #56

cryptax opened this issue Sep 20, 2024 · 3 comments

Comments

@cryptax
Copy link
Contributor

cryptax commented Sep 20, 2024

r2ai -mm is expected (according to doc -h) to list all downloaded models:

[r2ai:0x000061d0]> -mm
     ??? TheBloke/Mistral-7B-Instruct-v0.1-GGUF  
   2.96G cognitivecomputations/dolphin-2.9.4-llama3.1-8b-gguf
     ??? segolilylabs/Lily-Cybersecurity-7B-v0.2-GGUF
     ??? FaradayDotDev/llama-3-8b-Instruct-GGUF  
  11.94G ibm-granite/granite-20b-code-instruct-8k-GGUF

In reality, I only have those models:

$ ls -al ~/.local/share/r2ai/models/
total 15624388
drwxr-xr-x 2 axelle axelle        4096 Sep 17 10:07 .
drwxr-xr-x 3 axelle axelle        4096 Sep 17 10:07 ..
-rw-r--r-- 1 axelle axelle  3179141376 Aug 30 15:27 dolphin-2.9.4-llama3.1-8b-Q2_K.gguf
-rw-r--r-- 1 axelle axelle 12820207360 Sep 17 10:07 granite-20b-code-instruct.Q4_K_M.gguf
-rw-r--r-- 1 axelle axelle          89 Aug 30 11:40 llama.log

I think that TheBloke/Mistral-7B-Instruct-v0.1-GGUF , segolilylabs/Lily-Cybersecurity-7B-v0.2-GGUF and FaradayDotDev/llama-3-8b-Instruct-GGUF were downloaded by me before, but deleted. Looks like I didn't delete them properly for r2ai?

@cryptax
Copy link
Contributor Author

cryptax commented Sep 20, 2024

I tried to delete a model using -m- but it didn't work:

r2ai:0x000061d0]> -m-segolilylabs/Lily-Cybersecurity-7B-v0.2-GGUF
[r2ai:0x000061d0]> -mm
     ??? TheBloke/Mistral-7B-Instruct-v0.1-GGUF  
   2.96G cognitivecomputations/dolphin-2.9.4-llama3.1-8b-gguf
     ??? segolilylabs/Lily-Cybersecurity-7B-v0.2-GGUF
     ??? FaradayDotDev/llama-3-8b-Instruct-GGUF  
  11.94G ibm-granite/granite-20b-code-instruct-8k-GGUF

@trufae
Copy link
Contributor

trufae commented Sep 21, 2024

the meaning of ??? is that the model was registered in the .r2ai.model file from your home, but the file in disk was removed. we can purge them from the json automatically. but maybe we also want to know which files are in the models directory that are not registered by the json.

and yeah you cant remove a model that's not in disk. this can be fixed but maybe we can just silently update the json and hide those ??? . what do you think?

@cryptax
Copy link
Contributor Author

cryptax commented Sep 23, 2024

I think I'd silently update the json to remove the ???, and only leave it to advanced end-users to edit .r2ai.model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants