Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43,014

Base only

Active filters: bitsandbytes

RayNene/adaption_multi_agent_fraud_bench

Updated Aug 12 • 4 • 3

unsloth/Qwen3.8-27B-unsloth-bnb-4bit

27B • Updated Aug 25 • 276k • 16

RichardErkhov/huihui-ai_-_Llama-3.2-3B-Instruct-abliterated-8bits

3B • Updated Oct 26, 2024 • 15 • 1

unsloth/SmolLM2-1.7B-Instruct-bnb-4bit

Text Generation • 2B • Updated Oct 31, 2024 • 1.2k • 3

unsloth/Qwen2.5-Coder-32B-bnb-4bit

Text Generation • 34B • Updated Nov 12, 2024 • 112 • 6

secemp9/TraceBack-12b

Text Generation • 13B • Updated Mar 14, 2025 • 49 • 34

RichardErkhov/darkc0de_-_BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp-8bits

8B • Updated Mar 29, 2025 • 29 • 1

unsloth/Qwen3-14B-bnb-4bit

15B • Updated May 13, 2025 • 12.1k • 7

unsloth/Phi-4-mini-reasoning-unsloth-bnb-4bit

Text Generation • 4B • Updated May 1, 2025 • 816 • 9

unsloth/Phi-4-reasoning-plus-unsloth-bnb-4bit

Text Generation • 15B • Updated May 1, 2025 • 123 • 4

elementalsouls/Arch_nemesisv0.2

Text Generation • 7B • Updated May 31, 2025 • 9 • 1

169Pi/Alpie-Core

Text Generation • Updated Jun 19 • 58 • 9

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated Aug 8, 2025 • 4.87k • 20

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_text_encoder

6B • Updated Aug 18, 2025 • 7 • 4

detoxio-test/Qwen2.5-1.5B-Instruct_Jailbroken

Text Generation • 2B • Updated Aug 29, 2025 • 21 • 1

vpakarinen/qwen3-4b-lora-uncensored-thinking

Text Generation • Updated 5 days ago • 20 • 1

unsloth/Z-Image-Turbo-unsloth-bnb-4bit

Text-to-Image • 3B • Updated Jan 9 • 7.74k • 7

KrishnaHuYaar/Fitness-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 10 • 2

gokhanarkan/sommo-7b-v1

Text Generation • 8B • Updated Jan 13 • 17 • 2

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 223 • 7

Vishalshendge3198/orpheus-3b-tts-german-emotional-merged

Text-to-Speech • 3B • Updated Mar 21 • 1

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 68 • 11

tantk/vibevoice-1.5b-bnb-4bit

Text-to-Speech • 2B • Updated Apr 2 • 9 • 1

unsloth/gemma-4-31B-it-unsloth-bnb-4bit

Image-Text-to-Text • 31B • Updated Jul 17 • 19.5k • 25

Aero-Ex/KIMODO-Meta3_llm2vec_NF4

8B • Updated Apr 4 • 15.4k • 9

rajveer43/gemma-4-E4B-medical-legal-finance-qa

Text Generation • 8B • Updated Apr 12 • 293 • 13

cloverxion/gemma3-text-generative-1B-IT

Text Generation • 1B • Updated Apr 12 • 17 • 1

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 5 • 1

kelvinmbewe/ZambiaSocialBERT

Text Classification • 0.2B • Updated May 17 • 24 • 1

aguken-ai/Qwen-3-TTS-12Hz-0.6B-Base-hi-LoRA-Finetuned-BNB-NF4

Text-to-Speech • 0.9B • Updated May 26 • 96 • 9