Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
-
Updated
Nov 11, 2024 - Python
#
mixture-of-models
Here are 2 public repositories matching this topic...
The implementation of mixtures for different tasks.
linear-regression torch bayesian-methods ensemble ensemble-learning expectation-maximization-algorithm ensemble-prediction mixture-of-experts dirichlet-distributions mixture-of-models
-
Updated
Oct 17, 2024 - Python
Improve this page
Add a description, image, and links to the mixture-of-models topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mixture-of-models topic, visit your repo's landing page and select "manage topics."