Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,330

Full-text search

Active filters: gptq

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 13 days ago • 255k • 47

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated 13 days ago • 85.5k • 27

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 13 days ago • 148k • 26

baicai1145/s2-pro-w4a16

Text-to-Speech • 5B • Updated 6 days ago • 171 • 5

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 94.5k • 49

codgician/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4

Image-Text-to-Text • 28B • Updated 4 days ago • 4.11k • 2

happypatrick/Qwen3.5-122B-A10B-heretic-int4-AutoRound

Image-Text-to-Text • 19B • Updated about 21 hours ago • 70 • 2

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 19.6k • 606

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • 8B • Updated Apr 22, 2024 • 131 • 26

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 18.2k • 42

BitDistiller/Qwen-8B-w2g64-gptq

8B • Updated May 21, 2025 • 43 • 1

QuantTrio/Qwen3-235B-A22B-Thinking-2507-GPTQ-Int4-Int8Mix

Text Generation • 253B • Updated Sep 5, 2025 • 37 • 4

openguardrails/OpenGuardrails-Text-2510

Text Generation • 15B • Updated Feb 2 • 2.5k • 9

frankdarkluo/DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int8

Text Generation • 33B • Updated Dec 26, 2025 • 100 • 1

Ubuku/Qwen2.5-Math-72B-Instruct-GPTQ-Int4-TP2

73B • Updated Feb 8 • 6 • 1

Kbenkhaled/Qwen3.5-35B-A3B-quantized.w4a16

Image-Text-to-Text • 6B • Updated 17 days ago • 4.27k • 1

Kbenkhaled/Qwen3.5-27B-quantized.w4a16

Image-Text-to-Text • 28B • Updated 17 days ago • 2.9k • 2

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated 13 days ago • 14.1k • 15

blazingbhavneek/MOSS-TTS-GPTQ

Text-to-Speech • 3B • Updated 13 days ago • 65 • 2

Vishva007/Qwen3.5-0.8B-W4A16-AutoRound-GPTQ

0.9B • Updated 7 days ago • 127 • 2

oxzoid/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4

Image-Text-to-Text • 28B • Updated 6 days ago • 333 • 1

codgician/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4

Image-Text-to-Text • 36B • Updated 4 days ago • 802 • 1

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 15 • 40

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 10 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 7 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 20 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 7 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 2 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 11 • 45

TheBloke/koala-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 72 • 31