Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

542

Base only

Active filters: DPO

LoneStriker/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-8.0bpw-h8-exl2

Text Generation • Updated Jan 21, 2024 • 4

lighthouse-kr/Mistral-7B-lighthouse-merge-v0.1

Text Generation • 7B • Updated Jan 22, 2024 • 5

cloudyu/Yi-34Bx2-MoE-60B-DPO

Text Generation • 61B • Updated Aug 6, 2024 • 9.25k • 3

SJ-Donald/SJ-SOLAR-10.7b-DPO

Text Generation • 11B • Updated Mar 7, 2024 • 53

cloudyu/Truthful_DPO_TomGrc_FusionNet_34Bx2_MoE

Text Generation • 61B • Updated Jan 25, 2024 • 76 • 4

cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B

Text Generation • 61B • Updated Jan 25, 2024 • 71

yunconglong/MoE_13B_DPO

Text Generation • 13B • Updated Jan 28, 2024 • 9.19k • 7

yunconglong/13B_MATH_DPO

Text Generation • 13B • Updated Jan 28, 2024 • 74 • 1

pharaouk/fusedyi

Text Generation • 11B • Updated Feb 2, 2024 • 502

Andyrasika/mistral-ft-optimized-dpo

Text Generation • 7B • Updated Feb 5, 2024 • 12 • 4

mlx-community/NousHermes-Mixtral-8x7B-Reddit-mlx

47B • Updated Feb 8, 2024 • 109 • 6

tanamettpk/TC-instruct-DPO

Text Generation • 7B • Updated Apr 5, 2024 • 27 • 10

NousResearch/Nous-Hermes-2-Mistral-7B-DPO

Text Generation • 7B • Updated Apr 30, 2024 • 568 • • 222

NousResearch/Nous-Hermes-2-Mistral-7B-DPO-GGUF

7B • Updated Feb 21, 2024 • 3.27k • 95

mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX

7B • Updated Feb 21, 2024 • 75 • 5

bartowski/Nous-Hermes-2-Mistral-7B-DPO-exl2

Text Generation • Updated Feb 21, 2024 • 2 • 2

olafgeibig/Nous-Hermes-2-Mistral-7B-DPO-GGUF

7B • Updated Feb 21, 2024 • 95

solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 25 • 8

heyholetsgo/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • 7B • Updated Feb 24, 2024 • 14 • 1

solidrust/bagel-dpo-7b-v0.4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 19

solidrust/Ignis-7B-DPO-Laser-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 10

Weni/WeniGPT-2.5.3-Zephyr-7B-zephyr-prompt-LLM_Base_2.0.3_DPO_reduction_variation

Updated Feb 27, 2024

solidrust/Gecko-7B-v0.1-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 8

Weni/WeniGPT-2.6.3-Zephyr-7B-zephyr-prompt-LLM_Base_2.0.3_DPO_reduction_variation

Updated Feb 27, 2024

Weni/WeniGPT-2.7.3-Zephyr-7B-zephyr-prompt-LLM_Base_2.0.3_DPO_reduction_variation

Updated Feb 27, 2024

adamksn/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-GGUF

13B • Updated Mar 10, 2024 • 115 • 1

Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized

Updated Mar 8, 2024

Weni/WeniGPT-2.9.1-Zephyr-7B-zephyr-prompt-binarized-bitsandbytes

Updated Mar 8, 2024

Weni/WeniGPT-2.10.1-Zephyr-7B-DPO-prompt-binarized-GPTQ

Updated Mar 9, 2024

Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-DPO-binarized

Updated Mar 9, 2024