Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity – PaperGrep

https://papergrep.dev/paper/switch-transformers-scaling-to-trillion-parameter-25f952