Skip to content

Actions: NVIDIA/TransformerEngine

Blossom-CI

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
2,981 workflow runs
2,981 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

TransformerEngine FP8 is slower & more memory intensive than FlashAttention FP16?
Blossom-CI #3713: Issue comment #1119 (comment) created by ptrendx
August 23, 2024 18:45 3s
August 23, 2024 18:45 3s
Add support for flash-attn 3
Blossom-CI #3712: Issue comment #1019 (comment) created by cyanguwa
August 23, 2024 18:38 4s
August 23, 2024 18:38 4s
RMSNorm precision different from HF implementation
Blossom-CI #3711: Issue comment #1132 (comment) created by ptrendx
August 23, 2024 16:57 4s
August 23, 2024 16:57 4s
[ERROR] in the last step of pip install .
Blossom-CI #3710: Issue comment #1086 (comment) created by wplf
August 23, 2024 06:37 4s
August 23, 2024 06:37 4s
[ERROR] in the last step of pip install .
Blossom-CI #3709: Issue comment #1086 (comment) created by jinghere11
August 23, 2024 06:35 4s
August 23, 2024 06:35 4s
don't put master_param to state if None
Blossom-CI #3708: Issue comment #1130 (comment) created by akoumpa
August 23, 2024 05:01 4s
August 23, 2024 05:01 4s
Add support for flash-attn 3
Blossom-CI #3707: Issue comment #1019 (comment) created by ksivaman
August 23, 2024 04:51 4s
August 23, 2024 04:51 4s
August 23, 2024 02:40 4s
Add support for flash-attn 3
Blossom-CI #3705: Issue comment #1019 (comment) created by cyanguwa
August 23, 2024 01:57 4s
August 23, 2024 01:57 4s
Add support for flash-attn 3
Blossom-CI #3704: Issue comment #1019 (comment) created by cyanguwa
August 23, 2024 00:38 4s
August 23, 2024 00:38 4s
don't put master_param to state if None
Blossom-CI #3703: Issue comment #1130 (comment) created by ksivaman
August 22, 2024 20:53 3s
August 22, 2024 20:53 3s
how to use TransformerEngine without flash attention
Blossom-CI #3702: Issue comment #1123 (comment) created by sbhavani
August 22, 2024 19:47 4s
August 22, 2024 19:47 4s
don't put master_param to state if None
Blossom-CI #3701: Issue comment #1130 (comment) created by akoumpa
August 22, 2024 17:41 4s
August 22, 2024 17:41 4s
[PyTorch] make GroupedLinear inp support collection of torch.Tensor
Blossom-CI #3700: Issue comment #1120 (comment) created by BeingGod
August 22, 2024 15:15 4s
August 22, 2024 15:15 4s
[MoE][Common/PyTorch] Add permutation
Blossom-CI #3699: Issue comment #936 (comment) created by StudyingShao
August 22, 2024 10:20 5s
August 22, 2024 10:20 5s
Blossom-CI
Blossom-CI #3698: created by StudyingShao
August 22, 2024 10:18 4s
August 22, 2024 10:18 4s
Jax example cleanup and replace pjit with jit.
Blossom-CI #3697: Issue comment #1107 (comment) created by phu0ngng
August 21, 2024 17:52 4s
August 21, 2024 17:52 4s
[MoE][Common/PyTorch] Add permutation
Blossom-CI #3696: Issue comment #936 (comment) created by phu0ngng
August 21, 2024 17:06 4s
August 21, 2024 17:06 4s
Add high_precision_init_val to model params when using fp8_model_init
Blossom-CI #3695: Issue comment #1121 (comment) created by kunlunl
August 21, 2024 14:04 5s
August 21, 2024 14:04 5s
AttributeError: module 'transformer_engine' has no attribute 'pytorch'
Blossom-CI #3694: Issue comment #1014 (comment) created by arelkeselbri
August 21, 2024 12:43 5s
August 21, 2024 12:43 5s
[PyTorch] make GroupedLinear inp support collection of torch.Tensor
Blossom-CI #3693: Issue comment #1120 (comment) created by yaox12
August 21, 2024 09:56 4s
August 21, 2024 09:56 4s
[PyTorch] make GroupedLinear inp support collection of torch.Tensor
Blossom-CI #3692: Issue comment #1120 (comment) created by BeingGod
August 21, 2024 09:43 5s
August 21, 2024 09:43 5s
[PyTorch] make GroupedLinear inp support collection of torch.Tensor
Blossom-CI #3691: Issue comment #1120 (comment) created by yaox12
August 21, 2024 09:30 5s
August 21, 2024 09:30 5s
[PyTorch] FP8 MHA with RoPE and Miscellaneous Improvements
Blossom-CI #3690: Issue comment #1100 (comment) created by yaox12
August 21, 2024 08:42 5s
August 21, 2024 08:42 5s
Blossom-CI
Blossom-CI #3689: created by ben-8878
August 21, 2024 06:31 4s
August 21, 2024 06:31 4s