aptech0081 commited on
Commit
d0efaa5
·
verified ·
1 Parent(s): 974497c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +40 -5
README.md CHANGED
@@ -31,13 +31,15 @@ conversion and gives you inspectable standard LoRA keys).
31
 
32
  ## Files
33
 
34
- | File | Base trunk | sha256 |
35
  |---|---|---|
36
- | `minimax_h3_fl2va_pdd_acc_8step_comfyui.safetensors` | MiniMax-H3 **FL2VA** | `1dce71b9…5cda0ea` |
37
- | `minimax_h3_ref2va_pdd_acc_8step_comfyui.safetensors` | MiniMax-H3 **Ref2VA** | `5531fa0d…bdc78a1` |
 
38
 
39
- Put them in `ComfyUI/models/pdd_acc/`. Pair FL2VA with an fl2va UNET, Ref2VA with ref2va
40
- (bf16 or int8-convrot builds both work).
 
41
 
42
  ## Usage (recipe is mandatory)
43
 
@@ -47,6 +49,39 @@ boundaries) into `SamplerCustomAdvanced`. Strengths 1.0, `nfe` 8 (4 is also offi
47
  other distill LoRAs (turbo); don't stack step-caching nodes. A ready-to-run workflow ships in
48
  the node pack's `example_workflows/`.
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  ## What was converted
51
 
52
  Trunk LoRA renamed from diffusers to ComfyUI H3 keys (`diffusion_model.*.lora_A/B.weight`
 
31
 
32
  ## Files
33
 
34
+ | File | What it is | sha256 |
35
  |---|---|---|
36
+ | `minimax_h3_fl2va_pdd_acc_8step_comfyui.safetensors` | LoRA + head bank for **FL2VA** trunk | `1dce71b9…5cda0ea` |
37
+ | `minimax_h3_ref2va_pdd_acc_8step_comfyui.safetensors` | LoRA + head bank for **Ref2VA** trunk | `5531fa0d…bdc78a1` |
38
+ | `minimax_h3_ref2va_pdd_acc_8step_baked_int8_convrot.safetensors` | full **Ref2VA** int8-convrot checkpoint, trunk LoRA **pre-merged** — for cards that can't fully load the model ([see below](#baked-ref2va-trunk-for-cards-that-cant-fully-load-the-model)) | `fe8e58d8…cd1e111e` |
39
 
40
+ Put the LoRA files in `ComfyUI/models/pdd_acc/`. Pair FL2VA with an fl2va UNET, Ref2VA with
41
+ ref2va (bf16 or int8-convrot builds both work). The baked checkpoint goes in
42
+ `ComfyUI/models/diffusion_models/` instead.
43
 
44
  ## Usage (recipe is mandatory)
45
 
 
49
  other distill LoRAs (turbo); don't stack step-caching nodes. A ready-to-run workflow ships in
50
  the node pack's `example_workflows/`.
51
 
52
+ ## Baked Ref2VA trunk (for cards that can't fully load the model)
53
+
54
+ `minimax_h3_ref2va_pdd_acc_8step_baked_int8_convrot.safetensors` (34 GB) is
55
+ [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3)'s
56
+ `minimax_h3_ref2va_int8_convrot` checkpoint with this repo's Ref2VA trunk LoRA
57
+ **pre-merged at strength 1.0** (dequantize → add → requantize with the same `comfy-kitchen`
58
+ int8-convrot kernels ComfyUI itself uses; every tensor keeps its exact dtype, shape and byte
59
+ length). The PDD head bank is **not** in this file — it stays runtime, so you still need the
60
+ node pack and one of the LoRA files above.
61
+
62
+ **Why it exists:** ComfyUI merges LoRA patches into weights only for modules that fit in
63
+ VRAM; offloaded modules get a per-forward `lowvram patch` — the LoRA (plus a dequantize) is
64
+ re-applied on **every step**. On cards at the VRAM edge that fixed cost is large: ~2× s/it
65
+ at 864×480 on a 32 GB RTX 5090
66
+ ([node pack issue #4](https://github.com/Jalen-Brunson/ComfyUI-MiniMax-H3-PDD-Acc/issues/4)).
67
+ Baking removes the patch term entirely — measured on a fully-offloaded H200: 2.44 → 2.06 s/it
68
+ (`lowvram patches: 258 → 0`); the win grows as the card gets smaller. **If your card fully
69
+ loads the trunk, this file buys you nothing** — use a LoRA file above on a stock trunk.
70
+
71
+ **Usage:** put it in `ComfyUI/models/diffusion_models/`, load it with a plain **UNETLoader**,
72
+ and run the exact recipe above with the Apply node's **`lora_strength` set to `0.0`**
73
+ (baked-trunk mode: trunk patching skipped; head bank / sigmas / guards unchanged — the node's
74
+ `info` output confirms it). Point the Apply node at the **Ref2VA** LoRA file above (it still
75
+ supplies the head bank and the trained sigmas). Everything else is identical: SigmaShift
76
+ 12/3, the Apply node's sigmas → euler, CFG 1.0, `nfe` 8 (4 also official).
77
+
78
+ **Caveats:** the merge strength is frozen into the file — for another strength, the FL2VA
79
+ trunk, or a bf16/pruned base, `bake_pdd_trunk.py` in the node pack bakes any base yourself
80
+ (streaming write, a few GB of RAM). On an **unbaked** trunk, `lora_strength 0.0` silently
81
+ renders the un-distilled model with PDD heads — if unsure, check the file's safetensors
82
+ metadata for `pdd_acc_baked: true` (full bake provenance — source shas, strength, date — is
83
+ embedded there).
84
+
85
  ## What was converted
86
 
87
  Trunk LoRA renamed from diffusers to ComfyUI H3 keys (`diffusion_model.*.lora_A/B.weight`