Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,439

Base only

Active filters: it

Kaan35/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

12B • Updated Jul 29, 2024 • 14

GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 33

Kaan35/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Jul 26, 2024 • 20 • 1

WongBingbing/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 26, 2024 • 7

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 2

MarsupialAI/Lusca-33B

Text Generation • 33B • Updated Oct 22, 2024 • 10 • 10

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated May 5 • 63.9k • 30

JanneDoe/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 12

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 4

migtissera/Meta-Llama-3.1-405B

Text Generation • 410B • Updated Jul 27, 2024 • 10

Stark2008/SauerkrautLM-Nemo-12b-Instruct-Q3_K_L-GGUF

12B • Updated Jul 26, 2024 • 12

bartowski/mini-magnum-12b-v1.1-exl2

Text Generation • Updated Jul 27, 2024 • 4 • 1

IntervitensInc/Mistral-Nemo-Base-2407-chatml

Text Generation • 12B • Updated Aug 28, 2024 • 219 • • 6

ek826/Meta-Llama-3.1-405B-Instruct-4.0bpw-exl2

Text Generation • Updated Jul 27, 2024 • 9 • 3

aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored

Text Generation • 8B • Updated Jul 27, 2024 • 23 • • 10

thamada/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 8

Marcus-Arcadius/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 27, 2024 • 10

mozilla-ai/Meta-Llama-3.1-405B-llamafile

Updated Sep 23, 2024 • 1.48k • 4

ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 9, 2024 • 324 • 1

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3, 2024 • 1

ThomasBaruzier/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 23, 2024 • 273 • 3

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 1.79k • 19

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

8B • Updated Jul 28, 2024 • 1.44k • 2

bullerwins/Mistral-Large-Instruct-2407-exl2_5.5bpw

Text Generation • Updated Jul 27, 2024 • 3

bartowski/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 2.18k • 8

mradermacher/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Dec 16, 2024 • 1.91k • 3

mradermacher/Meta-Llama-3.1-8B-GGUF

8B • Updated Dec 16, 2024 • 443 • 1

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • 8B • Updated Aug 11, 2024 • 9 • • 2

mradermacher/Meta-Llama-3.1-8B-Instruct-i1-GGUF

8B • Updated Dec 16, 2024 • 1.03k • 3

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 584 • 5