Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

529

Base only

Active filters: lm-studio

Hob-forge/gpt-oss-20b-Q2_K-GGUF

Text Generation • 21B • Updated Aug 22 • 59 • 1

ahmedds10/gemma-3-270m-psychology-GGUF

0.3B • Updated Feb 9 • 60

bochen2079/AORTA-7B-GGUF

Text Generation • 8B • Updated Feb 15 • 36 • 3

Featherlabs/Aura-7b-GGUF

Text Generation • 8B • Updated Feb 28 • 139

BansheeTechnologies/Ouija-1.5B

Text Generation • 2B • Updated Feb 27 • 14 • 1

BansheeTechnologies/Ouija2-1.7B

Text Generation • 2B • Updated Feb 28 • 708 • 1

eewer/small-agent-20260303-mlx-8bit

Text Generation • 4B • Updated Mar 4 • 16

rudycaz/qwen35-27b-phish-finetuned-gguf

Text Generation • 27B • Updated Mar 4 • 45

Featherlabs/Aethon-4b-GGUF

Text Generation • 4B • Updated Mar 8 • 273

dineth554/legion-coder-8m

Text Generation • 56.8M • Updated Mar 8 • 31

dineth554/legion-coder-8m-10k

Text Generation • 56.8M • Updated Mar 8 • 22

wakari/Qwen3.5-27B-heretic-GGUF

27B • Updated Mar 12 • 48

Swicked86/phi4-mm-gguf

Visual Question Answering • 4B • Updated Mar 20 • 1.29k • 4

vanch007/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mlx-bf16

Image-Text-to-Text • 35B • Updated Mar 18 • 34 • 1

vanch007/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mlx-8bit

Image-Text-to-Text • 35B • Updated Mar 18 • 28

vanch007/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mlx-4bit

Image-Text-to-Text • 35B • Updated Mar 18 • 74 • 2

hasnainayaz/qehwa-pashto-llm-gguf

Text Generation • Updated Mar 17 • 1

EMD123/tiny-aya-kosher-3.3B-GGUF

3B • Updated Mar 17 • 149 • 1

continuum-ai/qwen2.5-0.5b-general-forged

Text Generation • 0.5B • Updated Apr 11 • 32

continuum-ai/qwen2.5-1.5b-general-forged

Text Generation • 2B • Updated Apr 11 • 44

continuum-ai/qwen2.5-3b-general-forged

Text Generation • 3B • Updated Apr 11 • 30

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 193 • 1

continuum-ai/qwen3.5-27b-code-forged

Text Generation • 27B • Updated Apr 11 • 75

FaisalFehad/Nemotron-3-Super-120B-A12B-MLX-6bit

Text Generation • 121B • Updated Mar 31 • 107 • 2

continuum-ai/qwen3.5-27b-code-forged-mlx-4bit

Text Generation • 14B • Updated Apr 11 • 266

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 45

continuum-ai/qwen3.5-27b-code-forged-defragged

Text Generation • 26B • Updated Apr 11 • 38

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 1.15k • 6

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 545 • 8

WithinUsAI/Llama3.2-Octo.Thinker.iNano-1B-GGUF

Text Generation • 1B • Updated Mar 30 • 183 • 1