ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

lora modules: all by default

Browse Source 
Former-commit-id: 52c4ae87c7f4312704c31ef26b079b2c5b95ea5f
This commit is contained in:
hiyouga
2024-06-06 03:53:28 +08:00
parent abc2a73a33
commit 937f49ec3d
23 changed files with 78 additions and 118 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/extras/fsdp_qlora/llama3_lora_sft.yaml
View File

@@ -6,7 +6,7 @@ quantization_bit: 4
stage: sft
do_train: true
finetuning_type: lora
lora_target: q_proj,v_proj
lora_target: all
### ddp
ddp_timeout: 180000000