v0.2.3 add language evaluations and remove registration to speedup loading tasks and models
What's Changed
- Update the blog link by @pufanyi in #196
- Bring back PR#52 by @kcz358 in #198
- fix: update from previous model_specific_prompt to current lmms_eval_kwargs to avoid warnings by @Luodian in #206
- [Feat] SGLang SRT commands in one go, async input for openai server by @kcz358 in #212
- [Minor] Add kill sglang process by @kcz358 in #213
- Support textonly inference for LLaVA-OneVision. by @CaraJ7 in #215
- Fix
videomme
evaluation by @zhijian-liu in #209 - [feat] remove registeration logic and adding language evaluation tasks. by @Luodian in #218
New Contributors
- @zhijian-liu made their first contribution in #209
Full Changelog: v0.2.2...v0.2.3