Skip to content

Commit

Permalink
fix claim
Browse files Browse the repository at this point in the history
  • Loading branch information
stephantul committed Feb 12, 2025
1 parent b87e336 commit 639bf86
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion model2vec/train/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -122,7 +122,7 @@ We use 14 classification datasets, using 1000 examples from the train set, and t

As you can see, full fine-tuning brings modest performance improvements in some cases, but very large ones in other cases, leading to a pretty large increase in average score. Our advice is to test both if you can use `potion-base-32m`, and to use full fine-tuning if you are starting from another base model.

The speed difference between model2vec and setfit is immense, with the full finetune being 50x faster than a setfit based on `all-minilm-l6-v2`.
The speed difference between model2vec and setfit is immense, with the full finetune being 35x faster than a setfit based on `all-minilm-l6-v2` on CPU.

| | logreg | full finetune | setfit
|:---------------------------|-----------:|---------------:|-------:|
Expand Down

0 comments on commit 639bf86

Please sign in to comment.