Config for reducing lora rank
#17
by drakexp - opened
Hi Kijai,
Can you share the config that you generally use to reduce lora rank, if you are using your kjnodes node to do it?
I've been using the sv_fro, so that you put the new_rank to the current rank, which is 128 in these loras, then dynamic_param to something like 0.95, rest stay default. This means it attemps to keep 95% of the "energy", it's an approximation, but usually works well enough.
How much can be reduced like that completely depends on the LoRA though, these loras seem to compress well but it's not always the case.
Also these LoRAs had some massive fused layers so I had to modify the code of that node to work on those, so KJNodes need to be on very latest to achieve the full reduction on some LoRAs.
drakexp changed discussion status to closed