Skip to content

1.0.2 Improve SummEval
Compare
Choose a tag to compare
@Muennighoff Muennighoff released this 28 Mar 10:33
· 1828 commits to main since this release
1.0.2
e189bae

Major changes to SummEval:

  • #99: Batched evaluation making it significantly faster
  • #99: Standardized interface to call encode with List[str] ; Previously it called model.encode with str, which lead to some wrong scores; All scores on the leaderboard have already been fixed
  • #97: Fixed typos

Other:

  • A new version of the paper has been released with cleaner plots & some additional scores 😊
  • Lots of cool models have been added to the leaderboard: https://huggingface.co/spaces/mteb/leaderboard
  • MTEB has been accepted to the EACL 2023 conference
Assets 2
Loading