suvadityamuk HF Staff commited on
Commit
896ea4f
·
verified ·
1 Parent(s): e0ebbe7

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +16 -8
README.md CHANGED
@@ -54,14 +54,16 @@ You ⇄ Gradio chat ⇄ open LLM (HF Inference Providers, billed to your account
54
  pay-as-you-go applies *only if you have enabled it* (PRO accounts include monthly credits).
55
  Long agentic builds can make dozens of calls per turn; plan mode adds planner + specialist
56
  calls on top.
57
- - **Local model (`zerogpu-local/Qwen3.5-35B-A3B`):** runs
58
- [Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B) (MoE, ~3B active params,
59
- thinking disabled) on this Space's own ZeroGPU. No provider billing at all — but its
60
- 72 GB of bf16 weights need a **full-GPU `xlarge` slice**, which consumes your free ZeroGPU
61
- quota at **2×** the normal rate (bigger quota when signed in, 8× with PRO). Each agent step
62
- also pays a GPU attach + weight-upload cost, so turns are slower than the provider models,
63
- and it remains weaker than the frontier options on complex scenes. Duplicators can override
64
- with the `LOCAL_LLM_MODEL` / `LOCAL_LLM_SIZE` env vars (e.g. a small model on `large`).
 
 
65
  - **Renders / animations:** GPU renders always use ZeroGPU quota, never provider credits.
66
  - **For anyone duplicating this Space:** if you set an `HF_TOKEN` secret, visitors who are
67
  not signed in fall back to *that token* for inference — i.e. **your** account pays. Remove
@@ -93,6 +95,12 @@ not to integrate them for now:
93
  If image/video diffusion models (e.g. texture generation) are added to this Space later,
94
  AOKit is the right tool to reach for first.
95
 
 
 
 
 
 
 
96
  ## Credits / licensing
97
 
98
  - `vendor/blender_mcp_addon/` and the `blender-mcp` Python package are the official
 
54
  pay-as-you-go applies *only if you have enabled it* (PRO accounts include monthly credits).
55
  Long agentic builds can make dozens of calls per turn; plan mode adds planner + specialist
56
  calls on top.
57
+ - **Local model (`zerogpu-local/Qwen3.5-35B-A3B-FP8`):** runs
58
+ [Qwen3.5-35B-A3B-FP8](https://huggingface.co/Qwen/Qwen3.5-35B-A3B-FP8) (MoE, ~3B active
59
+ params, official FP8 quantization) on this Space's own ZeroGPU. No provider billing at
60
+ all — its ~37 GB of FP8 weights fit the default half-GPU `large` slice (1× quota; bigger
61
+ quota when signed in, 8× with PRO). Each agent step still pays a GPU attach +
62
+ weight-upload cost, so turns are slower than the provider models, and it remains weaker
63
+ than the frontier options on complex scenes. A **💭 Thinking** toggle (local model only,
64
+ on by default) lets the model reason before each step — better results for extra GPU
65
+ seconds, never provider credits. Duplicators can override with the `LOCAL_LLM_MODEL` /
66
+ `LOCAL_LLM_SIZE` env vars (e.g. the bf16 checkpoint on `xlarge`).
67
  - **Renders / animations:** GPU renders always use ZeroGPU quota, never provider credits.
68
  - **For anyone duplicating this Space:** if you set an `HF_TOKEN` secret, visitors who are
69
  not signed in fall back to *that token* for inference — i.e. **your** account pays. Remove
 
95
  If image/video diffusion models (e.g. texture generation) are added to this Space later,
96
  AOKit is the right tool to reach for first.
97
 
98
+ Also evaluated: [unsloth's Qwen3.5-35B-A3B checkpoints](https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF).
99
+ Their quantized variants are GGUF (llama.cpp), which would replace the whole
100
+ transformers + ZeroGPU-packing inference stack; their safetensors repo mirrors the
101
+ official bf16 weights. The official FP8 checkpoint gives the size win inside the stack
102
+ we already have, so that is what ships.
103
+
104
  ## Credits / licensing
105
 
106
  - `vendor/blender_mcp_addon/` and the `blender-mcp` Python package are the official