Skip to content

Commit 8a58d76

Browse files
authored
chore(model gallery): add boomerang-qwen3-2.3b (#6460)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent c3442fe commit 8a58d76

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

gallery/index.yaml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3076,6 +3076,22 @@
30763076
- filename: DemyAgent-4B.i1-Q4_K_M.gguf
30773077
sha256: be619b23510debc492ddba73b6764382a8e0c4e97e5c206e0e2ee86d117c0878
30783078
uri: huggingface://mradermacher/DemyAgent-4B-i1-GGUF/DemyAgent-4B.i1-Q4_K_M.gguf
3079+
- !!merge <<: *qwen3
3080+
name: "boomerang-qwen3-2.3b"
3081+
icon: https://cdn-avatars.huggingface.co/v1/production/uploads/660591cbb8cda932fa1292ba/9eTKbCpP-C5rUHj26HTo_.png
3082+
urls:
3083+
- https://huggingface.co/Harvard-DCML/boomerang-qwen3-2.3B
3084+
- https://huggingface.co/mradermacher/boomerang-qwen3-2.3B-GGUF
3085+
description: |
3086+
Boomerang distillation is a phenomenon in LLMs where we can distill a teacher model into a student and reincorporate teacher layers to create intermediate-sized models with no additional training. This is the student model distilled from Qwen3-4B-Base from our paper.
3087+
This model was initialized from Qwen3-4B-Base by copying every other layer and the last 2 layers. It was distilled on 2.1B tokens of The Pile deduplicated with cross entropy, KL, and cosine loss to match the activations of Qwen3-4B-Base.
3088+
overrides:
3089+
parameters:
3090+
model: boomerang-qwen3-2.3B.Q4_K_M.gguf
3091+
files:
3092+
- filename: boomerang-qwen3-2.3B.Q4_K_M.gguf
3093+
sha256: 59d4fa743abb74177667b2faa4eb0f5bfd874109e9bc27a84d4ac392e90f96cc
3094+
uri: huggingface://mradermacher/boomerang-qwen3-2.3B-GGUF/boomerang-qwen3-2.3B.Q4_K_M.gguf
30793095
- &gemma3
30803096
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
30813097
name: "gemma-3-27b-it"

0 commit comments

Comments
 (0)