Spaces:
Running on Zero
Running on Zero
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -54,14 +54,16 @@ You ⇄ Gradio chat ⇄ open LLM (HF Inference Providers, billed to your account
|
|
| 54 |
pay-as-you-go applies *only if you have enabled it* (PRO accounts include monthly credits).
|
| 55 |
Long agentic builds can make dozens of calls per turn; plan mode adds planner + specialist
|
| 56 |
calls on top.
|
| 57 |
-
- **Local model (`zerogpu-local/Qwen3.5-35B-A3B`):** runs
|
| 58 |
-
[Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B) (MoE, ~3B active
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
quota
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
|
|
|
|
|
|
| 65 |
- **Renders / animations:** GPU renders always use ZeroGPU quota, never provider credits.
|
| 66 |
- **For anyone duplicating this Space:** if you set an `HF_TOKEN` secret, visitors who are
|
| 67 |
not signed in fall back to *that token* for inference — i.e. **your** account pays. Remove
|
|
@@ -93,6 +95,12 @@ not to integrate them for now:
|
|
| 93 |
If image/video diffusion models (e.g. texture generation) are added to this Space later,
|
| 94 |
AOKit is the right tool to reach for first.
|
| 95 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 96 |
## Credits / licensing
|
| 97 |
|
| 98 |
- `vendor/blender_mcp_addon/` and the `blender-mcp` Python package are the official
|
|
|
|
| 54 |
pay-as-you-go applies *only if you have enabled it* (PRO accounts include monthly credits).
|
| 55 |
Long agentic builds can make dozens of calls per turn; plan mode adds planner + specialist
|
| 56 |
calls on top.
|
| 57 |
+
- **Local model (`zerogpu-local/Qwen3.5-35B-A3B-FP8`):** runs
|
| 58 |
+
[Qwen3.5-35B-A3B-FP8](https://huggingface.co/Qwen/Qwen3.5-35B-A3B-FP8) (MoE, ~3B active
|
| 59 |
+
params, official FP8 quantization) on this Space's own ZeroGPU. No provider billing at
|
| 60 |
+
all — its ~37 GB of FP8 weights fit the default half-GPU `large` slice (1× quota; bigger
|
| 61 |
+
quota when signed in, 8× with PRO). Each agent step still pays a GPU attach +
|
| 62 |
+
weight-upload cost, so turns are slower than the provider models, and it remains weaker
|
| 63 |
+
than the frontier options on complex scenes. A **💭 Thinking** toggle (local model only,
|
| 64 |
+
on by default) lets the model reason before each step — better results for extra GPU
|
| 65 |
+
seconds, never provider credits. Duplicators can override with the `LOCAL_LLM_MODEL` /
|
| 66 |
+
`LOCAL_LLM_SIZE` env vars (e.g. the bf16 checkpoint on `xlarge`).
|
| 67 |
- **Renders / animations:** GPU renders always use ZeroGPU quota, never provider credits.
|
| 68 |
- **For anyone duplicating this Space:** if you set an `HF_TOKEN` secret, visitors who are
|
| 69 |
not signed in fall back to *that token* for inference — i.e. **your** account pays. Remove
|
|
|
|
| 95 |
If image/video diffusion models (e.g. texture generation) are added to this Space later,
|
| 96 |
AOKit is the right tool to reach for first.
|
| 97 |
|
| 98 |
+
Also evaluated: [unsloth's Qwen3.5-35B-A3B checkpoints](https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF).
|
| 99 |
+
Their quantized variants are GGUF (llama.cpp), which would replace the whole
|
| 100 |
+
transformers + ZeroGPU-packing inference stack; their safetensors repo mirrors the
|
| 101 |
+
official bf16 weights. The official FP8 checkpoint gives the size win inside the stack
|
| 102 |
+
we already have, so that is what ships.
|
| 103 |
+
|
| 104 |
## Credits / licensing
|
| 105 |
|
| 106 |
- `vendor/blender_mcp_addon/` and the `blender-mcp` Python package are the official
|