ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update examples

Browse Source 
Former-commit-id: c078582a759f6bce6e760cd39a05883f7eb194fe
This commit is contained in:
hiyouga
2024-04-02 20:51:21 +08:00
parent 933a084999
commit 38b59664e6
6 changed files with 34 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files

52
examples/README.md
View File

@@ -3,41 +3,41 @@ We provide diverse examples about fine-tuning LLMs.
```
examples/
├── lora_single_gpu/
│ ├── pt.sh: Pre-training
│ ├── sft.sh: Supervised fine-tuning
│ ├── reward.sh: Reward modeling
│ ├── ppo.sh: PPO training
│ ├── dpo.sh: DPO training
│ ├── orpo.sh: ORPO training
│ ├── pt.sh: Do pre-training
│ ├── sft.sh: Do supervised fine-tuning
│ ├── reward.sh: Do reward modeling
│ ├── ppo.sh: Do PPO training
│ ├── dpo.sh: Do DPO training
│ ├── orpo.sh: Do ORPO training
│ ├── prepare.sh: Save tokenized dataset
│ └── predict.sh: Batch prediction
│ └── predict.sh: Do batch predict
├── qlora_single_gpu/
│ ├── bitsandbytes.sh
│ ├── gptq.sh
│ ├── awq.sh
│ └── aqlm.sh
│ ├── bitsandbytes.sh: Fine-tune 4/8-bit BNB models
│ ├── gptq.sh: Fine-tune 4/8-bit GPTQ models
│ ├── awq.sh: Fine-tune 4-bit AWQ models
│ └── aqlm.sh: Fine-tune 2-bit AQLM models
├── lora_multi_gpu/
│ ├── single_node.sh
│ └── multi_node.sh
│ ├── single_node.sh: Fine-tune model with Accelerate on single node
│ └── multi_node.sh: Fine-tune model with Accelerate on multiple nodes
├── full_multi_gpu/
│ ├── single_node.sh
│ └── multi_node.sh
│ ├── single_node.sh: Fine-tune model with DeepSpeed on single node
│ └── multi_node.sh: Fine-tune model with DeepSpeed on multiple nodes
├── merge_lora/
│ ├── merge.sh: Merge LoRA weights
│ └── quantize.sh: Quantize with AutoGPTQ
│ ├── merge.sh: Merge LoRA weights into the pre-trained models
│ └── quantize.sh: Quantize fine-tuned model with AutoGPTQ
├── inference/
│ ├── cli_demo.sh
│ ├── api_demo.sh
│ ├── web_demo.sh
│ └── evaluate.sh
│ ├── cli_demo.sh: Launch a command line interface
│ ├── api_demo.sh: Launch an OpenAI-style API
│ ├── web_demo.sh: Launch a web interface
│ └── evaluate.sh: Evaluate model on the MMLU benchmark
└── extras/
├── galore/
│ └── sft.sh
│ └── sft.sh: Fine-tune model with GaLore
├── loraplus/
│ └── sft.sh
│ └── sft.sh: Fine-tune model with LoRA+
├── llama_pro/
│ ├── expand.sh
│ └── sft.sh
│ ├── expand.sh: Expand layers in the model
│ └── sft.sh: Fine-tune expanded model
└── fsdp_qlora/
└── sft.sh
└── sft.sh: Fine-tune quantized model with FSDP
```