Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

591

Base only

Active filters: fp4

FreedomAISVR/Gemma-4-12B-it-NVFP4-GGUF

Text Generation • 12B • Updated 5 days ago • 1.7k • 2

FreedomAISVR/Gemma-4-12B-it-MXFP4-GGUF

Text Generation • 12B • Updated 5 days ago • 483

hungtrieu07/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Jun 9 • 7

RedHatAI/gemma-4-12B-it-NVFP4

Any-to-Any • 13B • Updated 9 days ago • 183k • 4

GulfCoastAI/Mistral-Small-4-119B-Heretic-NVFP4

68B • Updated Jun 9 • 437 • 4

RedHatAI/diffusiongemma-26B-A4B-it-NVFP4

Image-Text-to-Text • 26B • Updated 15 days ago • 9.66k • 19

RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Text Generation • 303B • Updated 15 days ago • 166

FreedomAISVR/GLM-4.7-Flash-NVFP4-GGUF

Text Generation • 30B • Updated Jun 11 • 293 • 2

FreedomAISVR/GLM-4.7-Flash-MXFP4-MOE-GGUF

Text Generation • 30B • Updated Jun 11 • 66 • 1

LordAce9/Gemma-4-31B-it-QAT-MX46A_S-GGUF

Text Generation • 31B • Updated Jun 11 • 25

trohrbaugh/gemma-4-31b-it-heretic-ara-NVFP4

Image-Text-to-Text • 22B • Updated Jun 11 • 412 • 1

Mapika/MiniMax-M3-NVFP4

245B • Updated Jun 12 • 204 • 3

iofshofhe/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated Jun 13 • 15

brandonmusic/Rio-3.5-Open-397B-NVFP4

Text Generation • Updated Jun 22 • 10 • 4

kunhunjon/gemma-4-26B-A4B-it-qat-NVFP4-full

Text Generation • 14B • Updated Jun 16 • 25

turen01/GLM-5.1-NVFP4

Text Generation • 382B • Updated Jun 16 • 10

tonera/Qwen-Image-Edit-2511-Lightning-Nunchaku

Image-to-Image • Updated Jun 23 • 268 • 3

sahilchachra/Qwable-v1-NVFP4A16

Text Generation • 22B • Updated Jun 17 • 259

Mapika/GLM-5.2-NVFP4

Text Generation • 379B • Updated Jun 17 • 243 • 7

justinjja/GLM-5.2-NVFP4

425B • Updated Jun 17 • 45

sahilchachra/LocateAnything-3B-NVFP4A16

Image-Text-to-Text • 3B • Updated Jun 17 • 14

maci0/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NVFP4

Image-Text-to-Text • 39B • Updated 19 days ago • 9.22k • 13

chankhavu/smolmo-32b-nvfp4-step12750

Text Generation • 18B • Updated Jun 18 • 11

ilessio-aiflowlab/Qwen2.5-Coder-14B-Instruct-NVFP4-anima

Text Generation • 8B • Updated Jun 18 • 487

rootonchair/ERNIE-Image-Turbo-nunchaku-lite

Text-to-Image • Updated Jul 1 • 38

tonera/FLUX.2-klein-4B-Nunchaku

Image-to-Image • 4B • Updated Jun 23 • 814 • 5

dominant-strategies/quai-deepseek-v4-flash-igemm-fp4fp8

Text Generation • Updated Jun 19 • 12

decart-ai/Kimi-K2.7-Code-NVFP4

Text Generation • Updated Jun 19 • 669 • 2

mmangkad/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jun 23 • 56 • 3

tonera/Qwen-Image-2512-Lightning-Nunchaku

Text-to-Image • 20B • Updated Jun 23 • 68 • 2