Easily use CogVideoX-Fun inside ComfyUI!
TBD
The CogVideoX-Fun repository needs to be placed at ComfyUI/custom_nodes/CogVideoX-Fun/.
cd ComfyUI/custom_nodes/
# Git clone the cogvideox_fun itself
git clone https://github.com/aigc-apps/CogVideoX-Fun.git
# Git clone the video outout node
git clone https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git
cd CogVideoX-Fun/
python install.py
V1.5:
| Name | Storage Space | Hugging Face | Model Scope | Description |
|---|---|---|---|---|
| CogVideoX-Fun-V1.5-5b-InP | 20.0 GB | 🤗Link | 😄Link | Our official graph-generated video model is capable of predicting videos at multiple resolutions (512, 768, 1024) and has been trained on 85 frames at a rate of 8 frames per second. |
V1.1:
| Name | Storage Space | Hugging Face | Model Scope | Description |
|---|---|---|---|---|
| CogVideoX-Fun-V1.1-2b-InP | 13.0 GB | 🤗Link | 😄Link | Our official graph-generated video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. |
| CogVideoX-Fun-V1.1-5b-InP | 20.0 GB | 🤗Link | 😄Link | Our official graph-generated video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. Noise has been added to the reference image, and the amplitude of motion is greater compared to V1.0. |
| CogVideoX-Fun-V1.1-2b-Pose | 13.0 GB | 🤗Link | 😄Link | Our official pose-control video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. |
| CogVideoX-Fun-V1.1-5b-Pose | 20.0 GB | 🤗Link | 😄Link | Our official pose-control video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. |
| CogVideoX-Fun-V1.1-5b-Control | 20.0 GB | 🤗Link | 😄Link | Our official control video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. Supporting various control conditions such as Canny, Depth, Pose, MLSD, etc. |
| CogVideoX-Fun-V1.1-Reward-LoRAs | - | 🤗Link | 😄Link | The official reward backpropagation technology model optimizes the videos generated by CogVideoX-Fun-V1.1 to better match human preferences. ｜ |
V1.0:
| Name | Storage Space | Hugging Face | Model Scope | Description |
|---|---|---|---|---|
| CogVideoX-Fun-2b-InP | 13.0 GB | 🤗Link | 😄Link | Our official graph-generated video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. |
| CogVideoX-Fun-5b-InP | 20.0 GB | 🤗Link | 😄Link | Our official graph-generated video model is capable of predicting videos at multiple resolutions (512, 768, 1024, 1280) and has been trained on 49 frames at a rate of 8 frames per second. |
If you want to use lora in CogVideoX-Fun, please put the lora to ComfyUI/models/loras/cogvideox_fun/.
- LoadCogVideoX_Fun_Model
- Loads the CogVideoX-Fun model
- CogVideoX_FUN_TextBox
- Write the prompt for CogVideoX-Fun model
- CogVideoX_Fun_I2VSampler
- CogVideoX-Fun Sampler for Image to Video
- CogVideoX_Fun_T2VSampler
- CogVideoX-Fun Sampler for Text to Video
- CogVideoX_Fun_V2VSampler
- CogVideoX-Fun Sampler for Video to Video
Download link for v1.5.
Download link for v1.1.
Our ui is shown as follow:
You can run the demo using following video: demo video
Download link for v1.5.
Download link for v1.1.
Our ui is shown as follow:
You can run the demo using following photo:
Download link for v1.5.
Download link for v1.1.
Download link for v1.1.
Our ui is shown as follow:
You can run the demo using following video: demo video
Download link for v1.1.
Our ui is shown as follow:
