ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

support image input in api #3971 #4061

Browse Source 
Former-commit-id: c70aaf763ef22fb83ce3635e8ffd5ec4c89c1cb0
This commit is contained in:
hiyouga
2024-06-06 02:29:55 +08:00
parent 35379c7c0e
commit 639a7f6796
4 changed files with 49 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -456,6 +456,9 @@ docker compose -f ./docker-compose.yml up -d
CUDA_VISIBLE_DEVICES=0,1 API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml
```
> [!TIP]
> Visit https://platform.openai.com/docs/api-reference/chat/create for API document.
### Download from ModelScope Hub
If you have trouble with downloading models and datasets from Hugging Face, you can use ModelScope.