ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
00e17a377c6dfa0b62aa4b30e4c4f02c7148b7b6
LLaMA-Factory/examples/lora_single_gpu
History
hiyouga d764cd8736 support ORPO 
Former-commit-id: f44a4c27e2461cdaa1b16865f597a31033c0e6d9
2024-03-31 18:29:50 +08:00
..
dpo.sh
update examples
2024-03-06 13:14:57 +08:00
orpo.sh
support ORPO
2024-03-31 18:29:50 +08:00
ppo.sh
update examples
2024-03-06 13:14:57 +08:00
predict.sh
update examples
2024-03-06 13:14:57 +08:00
pretrain.sh
update examples
2024-03-06 13:14:57 +08:00
README.md
support ORPO
2024-03-31 18:29:50 +08:00
reward.sh
update examples
2024-03-06 13:14:57 +08:00
sft.sh
update examples
2024-03-06 13:14:57 +08:00

README.md

Usage:

  • pretrain.sh: do pre-train (optional)
  • sft.sh: do supervised fine-tuning
  • reward.sh: do reward modeling (must after sft.sh)
  • ppo.sh: do PPO training (must after sft.sh and reward.sh)
  • dpo.sh: do DPO training (must after sft.sh)
  • orpo.sh: do ORPO training
  • predict.sh: do predict (must after sft.sh and dpo.sh)