Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

tensor-parallel

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33

Base only

Active filters: tensor-parallel

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated Jul 21 • 101 • 3

dealignai/DeepSeek-V4-Flash-0731-CRACK-NVFP4

Text Generation • 304B • Updated 23 days ago • 2.24k • 21

0xSero/Ornith-1.5-35B-A3B-EXL3-2.75bpw

Text Generation • 9B • Updated 9 days ago • 187 • 3

jakejharris/jspark3

Image-Text-to-Text • 88B • Updated 1 day ago • 41 • 1

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP1

0.4B • Updated May 4 • 5

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP2

0.4B • Updated May 4 • 6

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP4

0.4B • Updated May 4 • 6

dominant-strategies/quai-deepseek-v4-flash-igemm-fp4fp8

Text Generation • Updated Jun 19 • 11

dominant-strategies/quai-deepseek-v4-flash-igemm-w8a8

Text Generation • Updated Jun 19 • 20

Cadododoom/Qwen3.6-35B-A3B-TextOnly-FP4

18B • Updated Jul 4 • 129

Cadododoom/Agents-A1-TextOnly-FP4

18B • Updated Jul 9 • 15 • 2

mitomtuna/MiMo-V2.5-NVFP4-TP3

200B • Updated Jul 10 • 17 • 1

mitomtuna/MiMo-V2.5-DFlash-TP3

2B • Updated Jul 8 • 17 • 1

mitomtuna/MiMo-V2.5-0703-NVFP4-TP3

200B • Updated Jul 13 • 37 • 6

xbill9/gemma-4-E4B-it-inferentia2

Text Generation • Updated Jul 12 • 1

xbill9/gemma-4-12B-it-inferentia2

Text Generation • Updated Jul 12 • 1

xbill9/gemma-4-31B-it-inferentia2

Text Generation • Updated Jul 16

xbill9/gemma-4-26B-A4B-it-inferentia2

Text Generation • Updated Jul 16

marianbusoi/Hy3-NVFP4-FP8-TP3

Text Generation • 300B • Updated Jul 28 • 28

Cadododoom/agents-a1-modelopt-nvfp4

18B • Updated Jul 28 • 16

Cadododoom/qwen3.6-35b-a3b-modelopt-nvfp4

18B • Updated Jul 28 • 35

bertholomus/DeepSeek-V4-Flash-0731-DSpark-Graph8

Text Generation • Updated about 1 month ago • 4

bertholomus/DeepSeek-V4-Flash-0731-DSpark-Graph8-4xGB10

Text Generation • Updated 22 days ago • 1

leoncca/Qwen3.5-122B-A10B-Heretic-Selective-AWQ

Image-Text-to-Text • 125B • Updated 11 days ago • 112

guruswami-ai/deepseek-v4-pro-0813-mlx-tp4-recipe

Text Generation • Updated 22 days ago • 1

pottokao/Qwen3.8-27B-NVFP4-MTP-2x16GB

Text Generation • 19B • Updated 17 days ago • 944 • 2

eemin/Qwen3.8-27B-NVFP4-MTP-2x16GB

Text Generation • 19B • Updated 16 days ago • 163

waqasm86/kaggle-vllm-models

Text Generation • Updated 4 days ago • 442

leoncca/Qwen3.8-27B-Huihui-AWQ

Image-Text-to-Text • 28B • Updated 10 days ago • 396

0xSero/Ornith-1.5-35B-A3B-EXL3-3bpw

Text Generation • 9B • Updated 9 days ago • 94