Instructions to use ABBNDZ/ATTS1HG1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use ABBNDZ/ATTS1HG1 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="ABBNDZ/ATTS1HG1", filename="ATTS1HG1_FP16.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use ABBNDZ/ATTS1HG1 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf ABBNDZ/ATTS1HG1:Q4_K_M # Run inference directly in the terminal: llama-cli -hf ABBNDZ/ATTS1HG1:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf ABBNDZ/ATTS1HG1:Q4_K_M # Run inference directly in the terminal: llama-cli -hf ABBNDZ/ATTS1HG1:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf ABBNDZ/ATTS1HG1:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf ABBNDZ/ATTS1HG1:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf ABBNDZ/ATTS1HG1:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf ABBNDZ/ATTS1HG1:Q4_K_M
Use Docker
docker model run hf.co/ABBNDZ/ATTS1HG1:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use ABBNDZ/ATTS1HG1 with Ollama:
ollama run hf.co/ABBNDZ/ATTS1HG1:Q4_K_M
- Unsloth Studio new
How to use ABBNDZ/ATTS1HG1 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ABBNDZ/ATTS1HG1 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ABBNDZ/ATTS1HG1 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ABBNDZ/ATTS1HG1 to start chatting
- Docker Model Runner
How to use ABBNDZ/ATTS1HG1 with Docker Model Runner:
docker model run hf.co/ABBNDZ/ATTS1HG1:Q4_K_M
- Lemonade
How to use ABBNDZ/ATTS1HG1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ABBNDZ/ATTS1HG1:Q4_K_M
Run and chat with the model
lemonade run user.ATTS1HG1-Q4_K_M
List all available models
lemonade list
Upload 17 files
Browse files- .gitattributes +17 -0
- samples/Abrahan_Mack_ru.wav +3 -0
- samples/Abrahan_Mack_tr.wav +3 -0
- samples/Adde_Michal_nl.wav +3 -0
- samples/Asya_Anara_en.wav +3 -0
- samples/Craig_Gutsy_cs.wav +3 -0
- samples/Damien_Black_zh.wav +3 -0
- samples/Dionisio_Schuyler_de.wav +3 -0
- samples/Dionisio_Schuyler_it.wav +3 -0
- samples/Gitta_Nikolina_ar.wav +3 -0
- samples/Ludvig_Milivoj_hu.wav +3 -0
- samples/Nova_Hogarth_hi.wav +3 -0
- samples/Royston_Min_pt.wav +3 -0
- samples/Viktor_Eka_pl.wav +3 -0
- samples/Viktor_Menelaos_ko.wav +3 -0
- samples/Vjollca_Johnnie_es.wav +3 -0
- samples/Vjollca_Johnnie_fr.wav +3 -0
- samples/Zacharie_Aimilios_ja.wav +3 -0
.gitattributes
CHANGED
|
@@ -36,3 +36,20 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 36 |
ATTS1HG1_q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
ATTS1HG1_q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
ATTS1HG1_FP16.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
ATTS1HG1_q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
ATTS1HG1_q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
ATTS1HG1_FP16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
samples/Abrahan_Mack_ru.wav filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
samples/Abrahan_Mack_tr.wav filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
samples/Adde_Michal_nl.wav filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
samples/Asya_Anara_en.wav filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
samples/Craig_Gutsy_cs.wav filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
samples/Damien_Black_zh.wav filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
samples/Dionisio_Schuyler_de.wav filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
samples/Dionisio_Schuyler_it.wav filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
samples/Gitta_Nikolina_ar.wav filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
samples/Ludvig_Milivoj_hu.wav filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
samples/Nova_Hogarth_hi.wav filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
samples/Royston_Min_pt.wav filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
samples/Viktor_Eka_pl.wav filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
samples/Viktor_Menelaos_ko.wav filter=lfs diff=lfs merge=lfs -text
|
| 53 |
+
samples/Vjollca_Johnnie_es.wav filter=lfs diff=lfs merge=lfs -text
|
| 54 |
+
samples/Vjollca_Johnnie_fr.wav filter=lfs diff=lfs merge=lfs -text
|
| 55 |
+
samples/Zacharie_Aimilios_ja.wav filter=lfs diff=lfs merge=lfs -text
|
samples/Abrahan_Mack_ru.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb8777d70a3a4bb05666a532321c62f23426e5daa501f837125ae18a4114c43d
|
| 3 |
+
size 268332
|
samples/Abrahan_Mack_tr.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:abc25b24bfc36acbf1dc6e1dd10ebda42740d933bcefda9f3d2e30f81a11d553
|
| 3 |
+
size 270380
|
samples/Adde_Michal_nl.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:148564c41edb6f1f80d14f844b00eb1e4b7ee242b58c563e8e26ac1a261bc0fe
|
| 3 |
+
size 235564
|
samples/Asya_Anara_en.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f811e31bfc18bde09bdd5afc4888d39f55ba09cf6d803043bf69cf04fe6974f9
|
| 3 |
+
size 288812
|
samples/Craig_Gutsy_cs.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:564768a31a87a51f2005e421f8fbec6ae4cd1b451e71e4667b0508f521c51390
|
| 3 |
+
size 227372
|
samples/Damien_Black_zh.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7981cc3ff891f9cfa0819677763d23a5f6d47ced7ea0fa25b9d53f0cae47f150
|
| 3 |
+
size 186412
|
samples/Dionisio_Schuyler_de.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:82434215366371e2848e5b06819678b6b356e2b4e900a31681c4a84078a3baad
|
| 3 |
+
size 262188
|
samples/Dionisio_Schuyler_it.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:73fcff2932e88bae7f7826190dad025c3ad96b10ed647809fda51e8ba7d0ba3f
|
| 3 |
+
size 202796
|
samples/Gitta_Nikolina_ar.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c722e79618af7dfb92d24bab493b6e6817c641a6623ac3969517d94f9ee8da0b
|
| 3 |
+
size 266284
|
samples/Ludvig_Milivoj_hu.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:498815e5a23b4a8ce28bd4bc84a24b2cd08f7a7685dde328e994bae3dce15b31
|
| 3 |
+
size 237612
|
samples/Nova_Hogarth_hi.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c0125cf9e5aefb77378f83072681c615c9ef83b03e8215c8cf470cda8c234050
|
| 3 |
+
size 301100
|
samples/Royston_Min_pt.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3315df0227335039eef269971b0c9a2cb4ef9cc361d6234b90aeab7a1539723e
|
| 3 |
+
size 198700
|
samples/Viktor_Eka_pl.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cbd11a7c5b73922cf72db286a451adbfeb1c5e5d34fd8fac9e4fdbefd51ac674
|
| 3 |
+
size 309292
|
samples/Viktor_Menelaos_ko.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9ddb65d4ed14ccbfe02e781fb454203377cf92669affbb49e7d55290d81806ab
|
| 3 |
+
size 354348
|
samples/Vjollca_Johnnie_es.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:265bff4ef87e025eb1fbe51382e02901ec15622f8bf2a7c6a59da7e61e4fa0fd
|
| 3 |
+
size 272428
|
samples/Vjollca_Johnnie_fr.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d8d36c67b1f69982e1affb31e093109241bf7d4cc3885935a57cea1acbff45b8
|
| 3 |
+
size 215084
|
samples/Zacharie_Aimilios_ja.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f3d53436f8bc9ad335b431d08b2d14b172abdb668532c93ecc649e81a569254
|
| 3 |
+
size 253996
|