A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
-
Updated
Aug 26, 2024 - Python
A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".
Add a description, image, and links to the mixture-of-adapters topic page so that developers can more easily learn about it.
To associate your repository with the mixture-of-adapters topic, visit your repo's landing page and select "manage topics."