ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[misc] support export ollama modelfile (#6899)

Browse Source 
* support export ollama modelfile

* update config

* add system and num ctx

Former-commit-id: 8c2af7466f4015f300b51841db11bcd2505ebf20
This commit is contained in:
hoshi-hiyouga
2025-02-11 19:52:25 +08:00
committed by GitHub
parent 3f7bd98bfa
commit 88eafd865b
14 changed files with 126 additions and 224 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
examples/merge_lora/llama3_gptq.yaml
View File

@@ -4,9 +4,9 @@ template: llama3
trust_remote_code: true
### export
export_dir: models/llama3_gptq
export_dir: output/llama3_gptq
export_quantization_bit: 4
export_quantization_dataset: data/c4_demo.json
export_size: 2
export_size: 5
export_device: cpu
export_legacy_format: false