Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -31,13 +31,15 @@ conversion and gives you inspectable standard LoRA keys).
|
|
| 31 |
|
| 32 |
## Files
|
| 33 |
|
| 34 |
-
| File |
|
| 35 |
|---|---|---|
|
| 36 |
-
| `minimax_h3_fl2va_pdd_acc_8step_comfyui.safetensors` |
|
| 37 |
-
| `minimax_h3_ref2va_pdd_acc_8step_comfyui.safetensors` |
|
|
|
|
| 38 |
|
| 39 |
-
Put
|
| 40 |
-
(bf16 or int8-convrot builds both work).
|
|
|
|
| 41 |
|
| 42 |
## Usage (recipe is mandatory)
|
| 43 |
|
|
@@ -47,6 +49,39 @@ boundaries) into `SamplerCustomAdvanced`. Strengths 1.0, `nfe` 8 (4 is also offi
|
|
| 47 |
other distill LoRAs (turbo); don't stack step-caching nodes. A ready-to-run workflow ships in
|
| 48 |
the node pack's `example_workflows/`.
|
| 49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
## What was converted
|
| 51 |
|
| 52 |
Trunk LoRA renamed from diffusers to ComfyUI H3 keys (`diffusion_model.*.lora_A/B.weight`
|
|
|
|
| 31 |
|
| 32 |
## Files
|
| 33 |
|
| 34 |
+
| File | What it is | sha256 |
|
| 35 |
|---|---|---|
|
| 36 |
+
| `minimax_h3_fl2va_pdd_acc_8step_comfyui.safetensors` | LoRA + head bank for **FL2VA** trunk | `1dce71b9…5cda0ea` |
|
| 37 |
+
| `minimax_h3_ref2va_pdd_acc_8step_comfyui.safetensors` | LoRA + head bank for **Ref2VA** trunk | `5531fa0d…bdc78a1` |
|
| 38 |
+
| `minimax_h3_ref2va_pdd_acc_8step_baked_int8_convrot.safetensors` | full **Ref2VA** int8-convrot checkpoint, trunk LoRA **pre-merged** — for cards that can't fully load the model ([see below](#baked-ref2va-trunk-for-cards-that-cant-fully-load-the-model)) | `fe8e58d8…cd1e111e` |
|
| 39 |
|
| 40 |
+
Put the LoRA files in `ComfyUI/models/pdd_acc/`. Pair FL2VA with an fl2va UNET, Ref2VA with
|
| 41 |
+
ref2va (bf16 or int8-convrot builds both work). The baked checkpoint goes in
|
| 42 |
+
`ComfyUI/models/diffusion_models/` instead.
|
| 43 |
|
| 44 |
## Usage (recipe is mandatory)
|
| 45 |
|
|
|
|
| 49 |
other distill LoRAs (turbo); don't stack step-caching nodes. A ready-to-run workflow ships in
|
| 50 |
the node pack's `example_workflows/`.
|
| 51 |
|
| 52 |
+
## Baked Ref2VA trunk (for cards that can't fully load the model)
|
| 53 |
+
|
| 54 |
+
`minimax_h3_ref2va_pdd_acc_8step_baked_int8_convrot.safetensors` (34 GB) is
|
| 55 |
+
[Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3)'s
|
| 56 |
+
`minimax_h3_ref2va_int8_convrot` checkpoint with this repo's Ref2VA trunk LoRA
|
| 57 |
+
**pre-merged at strength 1.0** (dequantize → add → requantize with the same `comfy-kitchen`
|
| 58 |
+
int8-convrot kernels ComfyUI itself uses; every tensor keeps its exact dtype, shape and byte
|
| 59 |
+
length). The PDD head bank is **not** in this file — it stays runtime, so you still need the
|
| 60 |
+
node pack and one of the LoRA files above.
|
| 61 |
+
|
| 62 |
+
**Why it exists:** ComfyUI merges LoRA patches into weights only for modules that fit in
|
| 63 |
+
VRAM; offloaded modules get a per-forward `lowvram patch` — the LoRA (plus a dequantize) is
|
| 64 |
+
re-applied on **every step**. On cards at the VRAM edge that fixed cost is large: ~2× s/it
|
| 65 |
+
at 864×480 on a 32 GB RTX 5090
|
| 66 |
+
([node pack issue #4](https://github.com/Jalen-Brunson/ComfyUI-MiniMax-H3-PDD-Acc/issues/4)).
|
| 67 |
+
Baking removes the patch term entirely — measured on a fully-offloaded H200: 2.44 → 2.06 s/it
|
| 68 |
+
(`lowvram patches: 258 → 0`); the win grows as the card gets smaller. **If your card fully
|
| 69 |
+
loads the trunk, this file buys you nothing** — use a LoRA file above on a stock trunk.
|
| 70 |
+
|
| 71 |
+
**Usage:** put it in `ComfyUI/models/diffusion_models/`, load it with a plain **UNETLoader**,
|
| 72 |
+
and run the exact recipe above with the Apply node's **`lora_strength` set to `0.0`**
|
| 73 |
+
(baked-trunk mode: trunk patching skipped; head bank / sigmas / guards unchanged — the node's
|
| 74 |
+
`info` output confirms it). Point the Apply node at the **Ref2VA** LoRA file above (it still
|
| 75 |
+
supplies the head bank and the trained sigmas). Everything else is identical: SigmaShift
|
| 76 |
+
12/3, the Apply node's sigmas → euler, CFG 1.0, `nfe` 8 (4 also official).
|
| 77 |
+
|
| 78 |
+
**Caveats:** the merge strength is frozen into the file — for another strength, the FL2VA
|
| 79 |
+
trunk, or a bf16/pruned base, `bake_pdd_trunk.py` in the node pack bakes any base yourself
|
| 80 |
+
(streaming write, a few GB of RAM). On an **unbaked** trunk, `lora_strength 0.0` silently
|
| 81 |
+
renders the un-distilled model with PDD heads — if unsure, check the file's safetensors
|
| 82 |
+
metadata for `pdd_acc_baked: true` (full bake provenance — source shas, strength, date — is
|
| 83 |
+
embedded there).
|
| 84 |
+
|
| 85 |
## What was converted
|
| 86 |
|
| 87 |
Trunk LoRA renamed from diffusers to ComfyUI H3 keys (`diffusion_model.*.lora_A/B.weight`
|