Prem
Collection
Finetunes and Quantizations of the Prem LLMs • 13 items • Updated • 2
How to use ucalyptus/prem-1B-chat-GGUF with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("ucalyptus/prem-1B-chat-GGUF", dtype="auto")Created using llama.cpp
4-bit