Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,607

Base only

Active filters: chat

mlx-community/Qwen2.5-14B-Instruct-3bit

Text Generation • Updated Apr 28, 2025 • 58 • 1

bullerwins/QVQ-72B-Preview-exl2_4.5bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 3

BlossomsAI/Qwen2.5-Coder-7B-Instruct-Uncensored-GGUF

8B • Updated Feb 11, 2025 • 3.46k • 5

sinatras/QVQ-Licensed-Fork

Image-Text-to-Text • 73B • Updated Dec 26, 2024

IntelligentEstate/Tiny-Sage-Restoration_Qwen2.5_IQ4_NL-GGUF

Text Generation • Updated Jan 22, 2025 • 1

CuckmeisterFuller/Hermes-3-Llama-3.2-3B-Q4-mlx

Text Generation • 0.5B • Updated Dec 27, 2024 • 56 • 1

fuzzy-mittenz/Thoth-Llama3.2-3B-IQ4_NL-GGUF

3B • Updated Feb 12, 2025 • 3 • 1

IntelligentEstate/Thoth_Warding-Llama-3B-IQ5_K_S-GGUF

3B • Updated Mar 7, 2025 • 24 • 4

QuantFactory/Control-Nanuq-8B-GGUF

8B • Updated Dec 27, 2024 • 1.71k • 2

phymbert/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 27, 2024 • 12

DonGan13/Qwen2.5-Coder-7B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Dec 27, 2024 • 10

DonGan13/Qwen2.5-Coder-7B-Instruct-IQ3_XXS-GGUF

Text Generation • 8B • Updated Dec 27, 2024 • 9

DonGan13/Qwen2.5-14B-Instruct-Q3_K_S-GGUF

Text Generation • 15B • Updated Dec 27, 2024 • 11

finnvoorhees/coreml-Qwen2.5-Coder-1.5B-Instruct-4bit

Text Generation • Updated Dec 27, 2024 • 17

Goekdeniz-Guelmez/josie-3b-v6.0-epoch1

Text Generation • 3B • Updated Dec 27, 2024 • 2

tensorblock/QwQ-32B-Preview-GGUF

33B • Updated Jan 27 • 38

finnvoorhees/coreml-Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Dec 28, 2024 • 77 • 1

finnvoorhees/coreml-Qwen2.5-Coder-0.5B-Instruct-4bit

Text Generation • Updated Dec 28, 2024 • 5

Lucy-in-the-Sky/QwQ-32B-Preview-Q4_K_M-GGUF

33B • Updated Dec 28, 2024 • 18

finnvoorhees/coreml-Qwen2.5-3B-Instruct-4bit

Text Generation • Updated Dec 28, 2024 • 112

itlwas/magnum-v4-22b-Q4_K_M-GGUF

Text Generation • 22B • Updated Dec 28, 2024 • 17

mrG46487/CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

Text Generation • 7B • Updated Dec 29, 2024 • 7

mradermacher/EZO-Qwen2.5-32B-Instruct-GGUF

33B • Updated Dec 29, 2024 • 45

mradermacher/EZO-Qwen2.5-32B-Instruct-i1-GGUF

33B • Updated Dec 29, 2024 • 64

evilfreelancer/o1_t-lite-it-1.0_lora

Question Answering • Updated Dec 30, 2024 • 2 • 3

Goekdeniz-Guelmez/josie-3b-v6.0

Text Generation • 3B • Updated Dec 29, 2024 • 9 • 1

Goekdeniz-Guelmez/josie-7b-v6.0

Text Generation • 8B • Updated Dec 29, 2024 • 5 • 2

Goekdeniz-Guelmez/josie-7b-v6.0-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 29, 2024 • 3 • 1

Goekdeniz-Guelmez/josie-3b-v6.0-Q5_K_M-GGUF

Text Generation • 3B • Updated Dec 29, 2024 • 7

nitky/Llama-3.3-SuperSwallowX-70B-RP-v0.1

Text Generation • 71B • Updated Dec 30, 2024 • 2