update readme and examples

Former-commit-id: 27dd9bf201c24f7804811398bc2758966ec78432
This commit is contained in:
hiyouga
2024-04-22 00:37:32 +08:00
parent be716972fe
commit ba06eb65ca
12 changed files with 266 additions and 13 deletions

View File

@@ -18,7 +18,8 @@ examples/
│ └── aqlm.sh: Fine-tune 2-bit AQLM models using QLoRA
├── lora_multi_gpu/
│ ├── single_node.sh: Fine-tune model with Accelerate on single node using LoRA
── multi_node.sh: Fine-tune model with Accelerate on multiple nodes using LoRA
── multi_node.sh: Fine-tune model with Accelerate on multiple nodes using LoRA
│ └── ds_zero3.sh: Fine-tune model with DeepSpeed ZeRO-3 using LoRA
├── full_multi_gpu/
│ ├── single_node.sh: Full fine-tune model with DeepSpeed on single node
│ ├── multi_node.sh: Full fine-tune model with DeepSpeed on multiple nodes