trying to run the MoE's inside llm-base, but is there a default config file available?

[lessw2020]

I've moved the files from here over to plug them into the llm-base and modified a lot of the main.py, utils, etc. to get the MoE model to load...but it's clearly missing an MoE based config file.
I don't know what are good defaults for softmax_order, etc. so wondering if you could post a general MoE config file to support these models here?
Thanks much!