gpt4all: 2.8.0 -> 3.2.1

[Titaniumtown]

Description of changes

Changelog
closes: #335993

Things done

Updated gpt4all and added a patch to disable compile-time fetching of an embeddings model, shifted that to be done directly in the nix package.

• Built on platform(s)
  • x86_64-linux
  • aarch64-linux
  • x86_64-darwin
  • aarch64-darwin
• For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
  • sandbox = relaxed
  • sandbox = true
• Tested, as applicable:
  • NixOS test(s) (look inside nixos/tests)
  • and/or package tests
  • or, for functions and "core" functionality, tests in lib/tests or pkgs/test
  • made sure NixOS tests are linked to the relevant packages
• Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
• Tested basic functionality of all binary files (usually in ./result/bin/)
• 24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)
  • (Package updates) Added a release notes entry if the change is major or breaking
  • (Module updates) Added a release notes entry if the change is significant
  • (Module addition) Added a release notes entry if adding a new NixOS module
• Fits CONTRIBUTING.md.

---

Add a 👍 reaction to pull requests you find important.

[Titaniumtown]

I've tested functionality locally on nixOS w/o any issues!

[ryand56]

PR title should be: gpt4all: 2.8.0 -> 3.2.1

[Titaniumtown]

@ryand56 fixed. lol. ty for pointing that out :)

[Titaniumtown]

@ryand56 does it all look good to you now?

[ryand56]

Looks good :) I'll test it later

[reedriley]

When I apply this patch and build on x86_64-linux, I end up with a file named 60c2zplz1cxvsy27xg7sr5nxirqpkmlr-nomic-embed-text-v1.5.f16.gguf (with a prepended Nix store hash) in $out/resources/ - which the resulting binary won't look for.

More specifically - no embeddings for local docs are being generated; and the console has the following error:

[Warning] (Wed Aug 28 12:39:01 2024): embllm WARNING: Local embedding model not found
[Warning] (Wed Aug 28 12:39:01 2024): WARNING: Could not load model for embeddings

[reedriley]

Here's what ended up working for me, in case it helps: e56a0c7

[Titaniumtown]

@reedriley thanks for the feedback! I'll apply your changes tomorrow. Good catch!

[Titaniumtown]

@reedriley just pushed your changes, ty <3

[reedriley]

LGTM!

[Titaniumtown]

@polygon any thoughts? the bot added you to review this :p

[polygon]

@polygon any thoughts? the bot added you to review this :p

Looks like @drupol pulled a nice bait and switch on me. I maintained this out-of-tree because I only sporadically find time for maintenance work. Then he pushed for adoption into Nixpkgs and removed himself as a maintainer shortly after.

I will look into this, but it can take some time. If anyone wants to co-maintain this package, feel free to take over.

[drupol]

@polygon Sorry mate, it's not intentional at all... I try to avoid maintaining stuff I don't use, or else it's too much work for me.

Regarding this GPT4All, I used to use it until I switched to open-webui that I maintain actively.

[Titaniumtown]

@polygon any thoughts? the bot added you to review this :p

Looks like @drupol pulled a nice bait and switch on me. I maintained this out-of-tree because I only sporadically find time for maintenance work. Then he pushed for adoption into Nixpkgs and removed himself as a maintainer shortly after.

I will look into this, but it can take some time. If anyone wants to co-maintain this package, feel free to take over.

I can work on it more if needed :) I want some more nix experience.

[felschr]

Commit message should be:

-gpt4all 2.8.0 -> 3.2.1
+gpt4all: 2.8.0 -> 3.2.1

@Titaniumtown if you wanna help maintain this package, you can also add yourself to the maitnainer-list.nix & meta.maintainers of this package.

[Titaniumtown]

@felschr I've added myself now! Thank you :)

[felschr]

@Titaniumtown adding yourself to the maintainers list & to meta.maintainers should be in separate commits, i.e. there should be 3 commits in total. Some of this is explained in CONTRIBUTING.md & maintainers/README.md but you can also check the git history for how people did this before.

[Titaniumtown]

oh so sorry. I'll fix that right now.

[felschr]

Also as you can see in the checks, maintainer-list.nix needs to be formatted.

[ToasterUwU]

Result of nixpkgs-review pr 337747 run on x86_64-linux 1

2 packages built:

• gpt4all
• gpt4all-cuda

[felschr]

@Titaniumtown thank you for the update and welcome as a package maintainer 🥳!

[Titaniumtown]

Thank you so much @felschr! I'm excited!