i want to test this so... please quantize it lol
#2085
by Guilherme34 - opened
0xSero/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-AutoRound-W4A16-draft
it's nemorton and it's already quantized, can I get the original nonquanted model?
i want just to turn into a gguf(i expressed badly)
it wont be full quality, but if you really want and there is no original size:
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-AutoRound-W4A16-draft-GGUF for quants to appear.