Models

12,281

Full-text search

Active filters: dpo

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 4 days ago • 1.47k • • 28

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 181

danielcherubini/Qwen3.5-DeltaCoder-9B

Text Generation • Updated Apr 1 • 9

reuben256/gemma-3n-4EB-dpo-v1

Updated 2 days ago • 2

capabl-machines/gridops-strategy-selector-v7

Updated 1 day ago • 126 • 2

mradermacher/SauerkrautLM-v2-14b-DPO-i1-GGUF

15B • Updated Dec 10, 2024 • 198 • 2

mradermacher/llama2-7b-dpo-full-wo-medication_qa-ep3-GGUF

7B • Updated Jan 24, 2025 • 154 • 1

trentmkelly/gpt-4o-distil-Llama-3.3-70B-Instruct

Text Generation • Updated Feb 2 • 7 • 2

manotham/Thai-dialogue-translate_emotion_mdpov2_ckp269

Translation • 4B • Updated 10 days ago • 246 • 1

kixlab/DiscoverLLM-creative-writing-Llama-3.1-8B-Instruct

Text Generation • Updated 4 days ago • 12 • 1

kixlab/DiscoverLLM-technical-writing-Llama-3.1-8B-Instruct

Text Generation • Updated 4 days ago • 13 • 1

kixlab/DiscoverLLM-svg-drawing-Llama-3.1-8B-Instruct

Text Generation • Updated 4 days ago • 13 • 1

tinyrolls/R1_Qwen3_8B_sft

8B • Updated 7 days ago • 17 • 1

XiaoXu123123/academic-humanize-qwen25-7b-dpo-v2-lora

Text Generation • Updated 6 days ago • 28 • 1

sajjadiba/TinyLlama-1.1B-Chat-SFT-ultrachat3k-DPO-argilla6k

1B • Updated 5 days ago • 111 • 1

jk200201/qwen2.5-coder-7b-bird-dpo

Text Generation • Updated 2 days ago • 18 • 1

F16/z-image-turbo-masked-dpo

Text-to-Image • Updated Apr 9 • • 23

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 12 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 15 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 10

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 18 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 23 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 19 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 87 • 123

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 4

ContextualAI/archangel_sft_pythia2-8b

Text Generation • 3B • Updated Jan 11, 2024 • 8 • 1

ContextualAI/archangel_sft_pythia6-9b

Text Generation • 7B • Updated Jan 11, 2024 • 17

ContextualAI/archangel_sft_pythia12-0b

Text Generation • 12B • Updated Jan 11, 2024 • 14