Former-commit-id: c3145afa4164dd28888f17599a154f7dddbe9326
This commit is contained in:
hiyouga
2024-03-06 17:25:08 +08:00
parent 7578209735
commit e93fb3cc6c
4 changed files with 15 additions and 17 deletions

View File

@@ -474,8 +474,7 @@ CUDA_VISIBLE_DEVICES=0 python src/train_bash.py \
#### 使用 Huggingface Accelerate
```bash
accelerate config # 首先配置分布式环境
accelerate launch src/train_bash.py # 参数同上
accelerate launch --config_file config.yaml src/train_bash.py # 参数同上
```
<details><summary>LoRA 训练的 Accelerate 配置示例</summary>