Text Generation
PEFT
lora
trl
naming
brand-generation
controllable-generation
krystv commited on
Commit
c6fa44b
·
verified ·
1 Parent(s): 1a3f95e

Add reproducible training Dockerfile

Browse files
Files changed (1) hide show
  1. Dockerfile +21 -0
Dockerfile ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM pytorch/pytorch:2.5.1-cuda12.4-cudnn9-runtime
2
+
3
+ WORKDIR /workspace/nomen-ai
4
+
5
+ RUN apt-get update && apt-get install -y --no-install-recommends \
6
+ git git-lfs build-essential && \
7
+ rm -rf /var/lib/apt/lists/*
8
+
9
+ COPY requirements.txt /workspace/nomen-ai/requirements.txt
10
+ RUN pip install --upgrade pip && pip install -r requirements.txt
11
+
12
+ COPY . /workspace/nomen-ai
13
+ RUN pip install -e .
14
+
15
+ ENV TRACKIO_PROJECT=nomen-ai
16
+ ENV TRACKIO_SPACE_ID=krystv/ml-intern-nomen001
17
+ ENV BASE_MODEL=Qwen/Qwen2.5-1.5B-Instruct
18
+ ENV SFT_DATASET=krystv/nomen-ai-sft
19
+ ENV DPO_DATASET=krystv/nomen-ai-dpo
20
+
21
+ CMD ["bash", "scripts/train_all_colab.sh"]