Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

2,214

Full-text search

Active filters: 2-bit

introvoyz041/Apriel-1.5-15b-Thinker-2bit-MLX-mlx-4Bit

Image-Text-to-Text • 1B • Updated 13 days ago • 65

MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF

Text Generation • 3B • Updated 10 days ago • 52.5k • 3

MaziyarPanahi/Ministral-3-8B-Reasoning-2512-GGUF

Text Generation • 8B • Updated 10 days ago • 355 • 1

MaziyarPanahi/Ministral-3-14B-Reasoning-2512-GGUF

Text Generation • 14B • Updated 10 days ago • 25.4k

MaziyarPanahi/Trinity-Nano-Preview-GGUF

Text Generation • 6B • Updated 10 days ago • 345 • 1

MaziyarPanahi/Trinity-Mini-GGUF

Text Generation • 26B • Updated 10 days ago • 26.4k • 1

apthebest01931/rnj-1-instruct-mlx-2Bit

0.8B • Updated 6 days ago • 48

jesusoctavioas/Olmo-3-1125-32B-mlx-2Bit

Text Generation • 32B • Updated 5 days ago • 52

PKU-DS-LAB/Fairy2i-W2

Text Generation • 7B • Updated 1 day ago • 21

shubhamg2208/tomoro-ai-colqwen3-embed-4b-auto-round-w2a16

1B • Updated 4 days ago • 12

shubhamg2208/tomoro-ai-colqwen3-embed-4b-auto-round-w2a16g32

1B • Updated 4 days ago • 16

Matt300209/autoround_test

1B • Updated 4 days ago • 11

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated 3 days ago • 173

fifrio/Qwen3-8B-gptq-2bit-calibration-English-128samples

8B • Updated 3 days ago • 11

fifrio/Qwen3-8B-gptq-2bit-calibration-Indonesian-128samples

8B • Updated 3 days ago • 13

fifrio/Qwen3-8B-gptq-2bit-calibration-Tamil-128samples

8B • Updated 3 days ago • 4

fifrio/Qwen3-8B-gptq-2bit-calibration-Swahili-128samples

8B • Updated 3 days ago • 9

fifrio/Qwen3-8B-gptq-2bit-calibration-Chinese-128samples

8B • Updated 3 days ago • 9

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated 3 days ago • 546

alexgusevski/Ministral-3-3B-Instruct-2512-q2-mlx

Text Generation • 0.3B • Updated 1 day ago • 11

alexgusevski/Ministral-3-3B-Reasoning-2512-q2-mlx

Text Generation • 0.3B • Updated 1 day ago • 10

alexgusevski/Ministral-3-8B-Instruct-2512-q2-mlx

Text Generation • 0.8B • Updated 1 day ago • 12

alexgusevski/Ministral-3-8B-Reasoning-2512-q2-mlx

Text Generation • 0.8B • Updated 1 day ago • 13

alexgusevski/Lightning-1.7B-q2-mlx

Text Generation • 0.2B • Updated 1 day ago • 7