Skip to content

Issues: linkedin/Liger-Kernel

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

44 Open 77 Closed
44 Open 77 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

No Significant Improvement Observed in Model Training Speed
#409 opened Nov 27, 2024 by lianghsun
Weighted Cross Entropy Loss
#404 opened Nov 21, 2024 by winglian
3
ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)
#401 opened Nov 20, 2024 by shivam15s
1
Apple's cross entropy computation
#391 opened Nov 17, 2024 by fzyzcjy
[RFC] Liger FlexChunkLoss: Alignment and Distillation loss
#371 opened Nov 8, 2024 by shivam15s
5 of 12 tasks
@shivam15s
16
Keyword arguments for liger functional
#368 opened Nov 8, 2024 by Tcc0403
@hongpeng-guo
2
cross entropy kernel: inplace modification of input
#343 opened Nov 4, 2024 by mgrabban
2
Overlap matrix multiplication (needs tensor core) and other things like activation (needs cuda core and memory bandwidth) to speed up
#341 opened Nov 4, 2024 by fzyzcjy
Possible support for weighted average loss calculation in FusedLinearCrossEntropy kernel
#338 opened Nov 1, 2024 by ChenlongDeng
FSDP fails with [ lm_head ] layer
#332 opened Oct 31, 2024 by gotzmann
5
Training LLaVA with the Liger kernel results in degraded performance.
#319 opened Oct 22, 2024 by y-rok
2
mllama patch modifies nn.LayerNorm globally
#315 opened Oct 19, 2024 by tyler-romero
3
Empty Medusa head tensors
#309 opened Oct 14, 2024 by vkc1vk
2
Add end-to-end example of mllama
#301 opened Oct 10, 2024 by shivam15s
@shivam15s
2024 Q4 Roadmap
#285 opened Sep 30, 2024 by ByronHsu
Add TVD (Total variation distance) Kernel feature
#281 opened Sep 28, 2024 by qingquansong
1
@saurabhkoshatwar
3
In-place operations in triton kernel might result in incorrect gradient calculations bug Something isn't working
#272 opened Sep 26, 2024 by Tcc0403
1
3
Encountered errors when reproducing lightning training example
#271 opened Sep 26, 2024 by ReginaZh
3
Choice of num_warps
#266 opened Sep 22, 2024 by Edenzzzz
7
Loss does not drop when using Liger Kernel at Qwen2.5
#257 opened Sep 19, 2024 by Se-Hun
11
ValueError when Loading Qwen2-VL Model with Liger Kernel
#249 opened Sep 16, 2024 by rahatarinasir
1
Support for Cohere models
#248 opened Sep 15, 2024 by nyxkrage
1
Is not compatible with DoRA? bug Something isn't working
#245 opened Sep 11, 2024 by gotzmann
1
Reasons for upcasting the logits dtype outside the kernel
#241 opened Sep 10, 2024 by yzhangcs
7
Benchmarking phi3 on single A100 40gb GPU: unable to reproduce benchmark results
#236 opened Sep 9, 2024 by cosmicBboy
3
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.