1.42.26

Full Changelog: 1.42.25...1.42.26

1.42.25

Full Changelog: 1.42.23...1.42.25

1.42.24

oops learned value residual mix does not apply to cross attention

1.42.23

deviate from paper and use softclamping instead for laser

1.42.22

safe log

1.42.21

What's Changed

• Support custom positions for rotary positional embedding by @Aceticia in #301

Full Changelog: 1.42.20...1.42.21

1.42.20

1.42.20

1.42.19

seeing a small but noticeable improvement from proposed Laser attenti…

1.42.18

address https://github.com/lucidrains/x-transformers/issues/296

1.42.17

Full Changelog: 1.42.16...1.42.17