ldwang 786a2f1103 Add patch_mixtral_replace_moe_impl for full training Mitral using DeepSpeed Zero3. ...

Signed-off-by: ldwang <ftgreat@gmail.com>

Former-commit-id: 5f50c02f0e425737cd80abdf8fde9e25abf13083

2024-01-24 15:25:31 +08:00

..

__init__.py

support function calling

2024-01-18 09:54:23 +08:00

adapter.py

format style

2024-01-20 20:15:56 +08:00

loader.py

🐞 fix: typo, move MoE fix to patcher

2024-01-22 16:01:58 +08:00

patcher.py

Add patch_mixtral_replace_moe_impl for full training Mitral using DeepSpeed Zero3.

2024-01-24 15:25:31 +08:00

utils.py

format style

2024-01-20 20:15:56 +08:00