Add dockerize support

Already tested with the model of Qwen:1.8B and the dataset of alpaca_data_zh. Some python libraries are added to the Dockerfile as a result of the exception messages displayed throughout test procedure.


Former-commit-id: 897e083bc28ccb15c46909b9d13fc03a674fb254
This commit is contained in:
S3Studio
2024-03-08 10:47:28 +08:00
committed by liuzhao2
parent d46c2bbcba
commit 6169df1c52
4 changed files with 75 additions and 0 deletions

15
Dockerfile Normal file
View File

@@ -0,0 +1,15 @@
FROM cnstark/pytorch:2.0.1-py3.9.17-cuda11.8.0-ubuntu20.04
WORKDIR /app
COPY requirements.txt /app/
RUN pip install -r requirements.txt && \
pip install tiktoken && \
pip install transformers_stream_generator
COPY . /app/
VOLUME [ "/root/.cache/huggingface/", "/app/data", "/app/output" ]
EXPOSE 7860
CMD [ "python", "src/train_web.py" ]