Update README.md
Browse files
README.md
CHANGED
|
@@ -93,7 +93,10 @@ model.generate_meta(
|
|
| 93 |
## Model Details
|
| 94 |
|
| 95 |
- Model Size : 2.1 B
|
| 96 |
-
- Checkpoint : 2000 k steps
|
|
|
|
|
|
|
|
|
|
| 97 |
|
| 98 |
## Checkpoint Result
|
| 99 |
|
|
|
|
| 93 |
## Model Details
|
| 94 |
|
| 95 |
- Model Size : 2.1 B
|
| 96 |
+
- Checkpoint : 2000 k steps (bs=1)
|
| 97 |
+
- Adapters : r=4, alpha=8
|
| 98 |
+
- lr = 1e-4
|
| 99 |
+
|
| 100 |
|
| 101 |
## Checkpoint Result
|
| 102 |
|