[trainer] Add Muon Optimizer (#7749)

Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-04-21 23:38:37 +08:00
parent 416853dd25
commit 12ada72ed4
10 changed files with 371 additions and 25 deletions
--- a/examples/README.md
+++ b/examples/README.md
@@ -215,6 +215,12 @@ llamafactory-cli api examples/inference/llama3_lora_sft.yaml

 ### Extras

+#### Full-Parameter Fine-Tuning using Muon
+
+```bash
+llamafactory-cli train examples/extras/muon/qwen2_full_sft.yaml
+```
+
 #### Full-Parameter Fine-Tuning using GaLore

 ```bash