ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update examples

Browse Source 
Former-commit-id: 66f248b90cfa2b29c73060459b2337b78154c47b
This commit is contained in:
hiyouga
2024-06-28 01:17:07 +08:00
parent 46f0189e88
commit 024760f866
18 changed files with 19 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/train_lora/llama3_lora_pretrain.yaml
View File

@@ -28,7 +28,7 @@ learning_rate: 1.0e-4
num_train_epochs: 3.0
lr_scheduler_type: cosine
warmup_ratio: 0.1
fp16: true
bf16: true
ddp_timeout: 180000000
### eval