Releases: lucidrains/x-transformers
Releases · lucidrains/x-transformers
0.0.29
add sandwich coefficient, from sandwich transformers. also allow user…
0.0.28
add rezero for encoder, decoder, and funnel encoder
0.0.27
fix masking for memory key/values exist
0.0.26
add attention on attention (gating on final attention output, with qu…
0.0.25
fix funnel transformer so that downsample is query-only
0.0.24
make sure masks work with funnel transformer
0.0.23
make sure each bottleneck section in funnel transformer share a diffe…
0.0.22
add funnel transformer
0.0.21
fix encoder feedforward glu
0.0.20
fix bug with encoder relative pos emb