1.42.21

What's Changed

• Support custom positions for rotary positional embedding by @Aceticia in #301

Full Changelog: 1.42.20...1.42.21

1.42.20

1.42.20

1.42.19

seeing a small but noticeable improvement from proposed Laser attenti…

1.42.18

address https://github.com/lucidrains/x-transformers/issues/296

1.42.17

Full Changelog: 1.42.16...1.42.17

1.42.16

Full Changelog: 1.42.15...1.42.16

1.42.15

Full Changelog: 1.42.12...1.42.15

1.42.14

seeing really big improvements with per token learned value residual …

1.42.12

What's Changed

• Add packaging as requirement by @iamthebot in #295

New Contributors

• @iamthebot made their first contribution in #295

Full Changelog: 1.42.11...1.42.12

1.42.11

address https://github.com/lucidrains/x-transformers/issues/291