Skip to content

langport 0.3.2
Compare
Choose a tag to compare
@jstzwj jstzwj released this 19 Jul 09:11
· 81 commits to main since this release
0.3.2
ccc8d67
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

  • Support 4bit quantization
  • Support InternLM and Llama2
  • Faster 8bit inference
Assets 2
Loading