Instructions to use wolfram/miquliz-120b-v2.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use wolfram/miquliz-120b-v2.0 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("wolfram/miquliz-120b-v2.0", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Strange observation: model becomes super horny in ST's MinP mode
5
#7 opened about 2 years ago
by deleted
Reccomended prompt settings and Text Completion settings?
#6 opened about 2 years ago
by
ZootZootTesla
Merge method
1
#4 opened about 2 years ago
by
dnhkng
VRAM Estimates
6
#3 opened about 2 years ago
by
ernestr
GPTQ / AWQ
1
#2 opened about 2 years ago
by
agahebr
Some additional quants added
👍 2
#1 opened over 2 years ago
by
mradermacher