Skip to content

v0.2.3 add language evaluations and remove registration to speedup loading tasks and models

Compare
Choose a tag to compare
@Luodian Luodian released this 01 Sep 11:21
· 187 commits to main since this release
30a0745

What's Changed

  • Update the blog link by @pufanyi in #196
  • Bring back PR#52 by @kcz358 in #198
  • fix: update from previous model_specific_prompt to current lmms_eval_kwargs to avoid warnings by @Luodian in #206
  • [Feat] SGLang SRT commands in one go, async input for openai server by @kcz358 in #212
  • [Minor] Add kill sglang process by @kcz358 in #213
  • Support textonly inference for LLaVA-OneVision. by @CaraJ7 in #215
  • Fix videomme evaluation by @zhijian-liu in #209
  • [feat] remove registeration logic and adding language evaluation tasks. by @Luodian in #218

New Contributors

Full Changelog: v0.2.2...v0.2.3