0.2.0

What's Changed

• FIx dispatch_weights softmax dimension by @Chris-Nicholls in #1

New Contributors

• @Chris-Nicholls made their first contribution in #1

Full Changelog: 0.1.0...0.2.0

0.1.0

First full release for PyPI

• SoftMoE layer
• Transformer layers with Soft MoE
• ViT models, with and without Soft MoE
• ablations from paper

0.1.0rc1

First prerelease candidate for PyPI