ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
04423b916f5246719e5409b6e8c29f345f596a32
LLaMA-Factory/examples/merge_lora/README.md
hiyouga 056d2d956a support vllm 
Former-commit-id: 889f6e910e654d8ec3922c2185042d737ffbf1c3
2024-03-07 20:26:31 +08:00

127 B
Raw Blame History

Usage:

  • merge.sh: merge the lora weights
  • quantize.sh: quantize the model with AutoGPTQ (must after merge.sh, optional)