Skip to content

Issues: linkedin/Liger-Kernel

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

49 Open 129 Closed
49 Open 129 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

GKD trainer + chunked JSD loss + FSDP
#615 opened Mar 17, 2025 by benyaminjami
1
Support Dynamic Tanh (DyT)
#607 opened Mar 14, 2025 by shivam15s
1
2
Support Gemma 3 Arch
#604 opened Mar 12, 2025 by fizzAI
3
[bug] deepspeed zero++ multinode with liger kernel
#603 opened Mar 11, 2025 by SoundProvider
When enabling naive model parallelism using device_map, the liger-kernel does not work.
#593 opened Mar 3, 2025 by Songjw133
1
[transformers][FLCE] make compatible with latest (>=4.49.0) XXXForCausalLM.forward APIs good first issue Good for newcomers huggingface
#573 opened Feb 20, 2025 by yundai424
1
transformers is meant to be an optional dep but import fails without it
#569 opened Feb 19, 2025 by tyler-romero
The convergence test test_mini_models_with_logits is failing with the latest transformers bug Something isn't working
#543 opened Jan 27, 2025 by Tcc0403
7
revert_liger_kernel_to_xxx can't revert LigerCrossEntropyLoss for transformers>=4.46.1 bug Something isn't working
#542 opened Jan 27, 2025 by Tcc0403
7
Issue while building from source on ROCM
#538 opened Jan 22, 2025 by agunapal
1
4
Support the new Solar architecture
#537 opened Jan 22, 2025 by arnavgarg1
2
Gradient checkpointing for grad_weight in LFCE
#533 opened Jan 20, 2025 by cassanof
4
Memory Optimization with Liger Kernel Shows Limited Effect on larger Model （more than 7B）
#517 opened Jan 8, 2025 by dyyoungg
3
Any plans to add models from the llava series?
#514 opened Jan 6, 2025 by jp1924
@jp1924
12
Megatron Support
#513 opened Jan 4, 2025 by huyiwen
2
LigerFusedLinearCrossEntropyLoss Causes Training Loss to Diverge After Reaching ~8
#512 opened Jan 4, 2025 by penghui-yang
7
Consider support liger kernel for internlm model
#505 opened Dec 29, 2024 by 14H034160212
Extending Liger-Kernel Optimizations to Encoder Models Like BER
#500 opened Dec 26, 2024 by pengzhangzhi
Potential Optimization for Preference Training with Prefix Sharing
#476 opened Dec 13, 2024 by austin362667
@austin362667
Support offline logits for teacher model
#441 opened Dec 9, 2024 by austin362667
@austin362667
PreferenceBase with Softcapping?
#426 opened Dec 4, 2024 by cinjon
1
2
The accuracy is misaligned when using bf16
#414 opened Nov 28, 2024 by starstream
1
No Significant Improvement Observed in Model Training Speed
#409 opened Nov 27, 2024 by lianghsun
8
Weighted Cross Entropy Loss
#404 opened Nov 21, 2024 by winglian
2
4
ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)
#401 opened Nov 20, 2024 by shivam15s
1
ProTip! Updated in the last three days: updated:>2025-03-17.