Qwen3-VL Abliteration
Collection
Qwen3-VL Abliterated Model Collection [ Version 1.0 ]
•
16 items
•
Updated
•
8
Qwen3-VL-abliterated-AIO-GGUF
The Qwen3-VL abliterated series from prithivMLmods comprises customized variants of Qwen3-VL 2B, 4B, and 8B Instruct and Thinking models that have undergone “abliteration” to remove or relax safety guardrails, enabling uncensored, highly detailed reasoning and captioning over a wide range of visual and multimodal content, including complex, sensitive, or nuanced images and layouts. These models are fine-tuned to produce rich, high-fidelity descriptions, step-by-step visual reasoning, and flexible output granularity (from concise summaries to intricate, multi-level narratives) while remaining robust across diverse resolutions and aspect ratios. Built on the strong multimodal understanding and instruction-following capabilities of the original Qwen3-VL Instruct and Thinking backbones, they preserve multilingual capability (primarily English, with prompt-engineered multilingual support) and are particularly suited for research, red-teaming, uncensored captioning, creative generation, and advanced visual reasoning scenarios where standard safety filters would otherwise limit outputs.
Quick Start with llama.cpp / Download using HF Download
You can run this model directly with llama.cpp or download it using the Hugging Face Hub.
Use with llama.cpp (Recommended)
Link: https://huggingface.co/prithivMLmods/Qwen3-VL-abliterated-AIO-GGUF?local-app=llama.cpp
Clone the Repository
git clone https://huggingface.co/prithivMLmods/Qwen3-VL-abliterated-AIO-GGUF
Download with hf-download
from huggingface_hub import snapshot_download
snapshot_download(
repo_id="prithivMLmods/Qwen3-VL-abliterated-AIO-GGUF",
local_dir="./model",
resume_download=True,
)
Qwen3-VL-8B-Instruct-abliterated-v1 [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VL-8B-Instruct-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 4.59 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q2_K.gguf | Q2_K | 3.28 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 4.43 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 4.12 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 3.77 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 5.03 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 4.8 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 5.85 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 5.72 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q6_K.gguf | Q6_K | 6.73 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.Q8_0.gguf | Q8_0 | 8.71 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.f16.gguf | F16 | 16.4 GB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 752 MB | Download |
| Qwen3-VL-8B-Instruct-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 1.16 GB | Download |
Qwen3-VL-8B-Thinking-abliterated-v1 [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VL-8B-Thinking-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 4.59 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q2_K.gguf | Q2_K | 3.28 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 4.43 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 4.12 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 3.77 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 5.03 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 4.8 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 5.85 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 5.72 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q6_K.gguf | Q6_K | 6.73 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.Q8_0.gguf | Q8_0 | 8.71 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.f16.gguf | F16 | 16.4 GB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 752 MB | Download |
| Qwen3-VL-8B-Thinking-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 1.16 GB | Download |
Qwen3-VL-4B-Instruct-abliterated-v1 [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VL-4B-Instruct-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 2.29 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q2_K.gguf | Q2_K | 1.67 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 2.24 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 2.08 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 1.89 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 2.5 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 2.38 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 2.89 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 2.82 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q6_K.gguf | Q6_K | 3.31 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.Q8_0.gguf | Q8_0 | 4.28 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.f16.gguf | F16 | 8.05 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ1_M.gguf | i1-IQ1_M | 1.13 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ1_S.gguf | i1-IQ1_S | 1.06 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_M.gguf | i1-IQ2_M | 1.51 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_S.gguf | i1-IQ2_S | 1.42 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_XS.gguf | i1-IQ2_XS | 1.35 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 1.25 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_M.gguf | i1-IQ3_M | 1.96 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_S.gguf | i1-IQ3_S | 1.9 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_XS.gguf | i1-IQ3_XS | 1.81 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 1.67 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ4_NL.gguf | i1-IQ4_NL | 2.38 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ4_XS.gguf | i1-IQ4_XS | 2.27 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q2_K.gguf | i1-Q2_K | 1.67 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q2_K_S.gguf | i1-Q2_K_S | 1.56 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_L.gguf | i1-Q3_K_L | 2.24 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_M.gguf | i1-Q3_K_M | 2.08 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_S.gguf | i1-Q3_K_S | 1.89 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_0.gguf | i1-Q4_0 | 2.38 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_1.gguf | i1-Q4_1 | 2.6 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_K_M.gguf | i1-Q4_K_M | 2.5 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_K_S.gguf | i1-Q4_K_S | 2.38 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q5_K_M.gguf | i1-Q5_K_M | 2.89 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q5_K_S.gguf | i1-Q5_K_S | 2.82 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q6_K.gguf | i1-Q6_K | 3.31 GB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.imatrix.gguf | imatrix | 3.87 MB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 454 MB | Download |
| Qwen3-VL-4B-Instruct-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 836 MB | Download |
Qwen3-VL-4B-Thinking-abliterated-v1 [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VL-4B-Thinking-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 2.29 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q2_K.gguf | Q2_K | 1.67 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 2.24 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 2.08 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 1.89 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 2.5 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 2.38 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 2.89 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 2.82 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q6_K.gguf | Q6_K | 3.31 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.Q8_0.gguf | Q8_0 | 4.28 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.f16.gguf | F16 | 8.05 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ1_M.gguf | i1-IQ1_M | 1.13 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ1_S.gguf | i1-IQ1_S | 1.06 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ2_M.gguf | i1-IQ2_M | 1.51 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ2_S.gguf | i1-IQ2_S | 1.42 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ2_XS.gguf | i1-IQ2_XS | 1.35 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 1.25 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ3_M.gguf | i1-IQ3_M | 1.96 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ3_S.gguf | i1-IQ3_S | 1.9 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ3_XS.gguf | i1-IQ3_XS | 1.81 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 1.67 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ4_NL.gguf | i1-IQ4_NL | 2.38 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-IQ4_XS.gguf | i1-IQ4_XS | 2.27 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q2_K.gguf | i1-Q2_K | 1.67 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q2_K_S.gguf | i1-Q2_K_S | 1.56 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q3_K_L.gguf | i1-Q3_K_L | 2.24 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q3_K_M.gguf | i1-Q3_K_M | 2.08 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q3_K_S.gguf | i1-Q3_K_S | 1.89 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q4_0.gguf | i1-Q4_0 | 2.38 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q4_1.gguf | i1-Q4_1 | 2.6 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q4_K_M.gguf | i1-Q4_K_M | 2.5 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q4_K_S.gguf | i1-Q4_K_S | 2.38 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q5_K_M.gguf | i1-Q5_K_M | 2.89 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q5_K_S.gguf | i1-Q5_K_S | 2.82 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.i1-Q6_K.gguf | i1-Q6_K | 3.31 GB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.imatrix.gguf | imatrix | 3.87 MB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 454 MB | Download |
| Qwen3-VL-4B-Thinking-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 836 MB | Download |
Qwen3-VL-2B-Instruct-abliterated-v1 [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VL-2B-Instruct-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 1.02 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q2_K.gguf | Q2_K | 778 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 1 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 940 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 867 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 1.11 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 1.06 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 1.26 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 1.23 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q6_K.gguf | Q6_K | 1.42 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.Q8_0.gguf | Q8_0 | 1.83 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.f16.gguf | F16 | 3.45 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_M.gguf | i1-IQ1_M | 544 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ1_S.gguf | i1-IQ1_S | 516 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_M.gguf | i1-IQ2_M | 695 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_S.gguf | i1-IQ2_S | 658 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XS.gguf | i1-IQ2_XS | 632 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 590 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_M.gguf | i1-IQ3_M | 896 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_S.gguf | i1-IQ3_S | 867 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XS.gguf | i1-IQ3_XS | 834 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 754 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_NL.gguf | i1-IQ4_NL | 1.05 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-IQ4_XS.gguf | i1-IQ4_XS | 1.01 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K.gguf | i1-Q2_K | 778 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q2_K_S.gguf | i1-Q2_K_S | 733 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_L.gguf | i1-Q3_K_L | 1 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_M.gguf | i1-Q3_K_M | 940 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q3_K_S.gguf | i1-Q3_K_S | 867 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_0.gguf | i1-Q4_0 | 1.06 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_1.gguf | i1-Q4_1 | 1.14 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_M.gguf | i1-Q4_K_M | 1.11 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q4_K_S.gguf | i1-Q4_K_S | 1.06 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_M.gguf | i1-Q5_K_M | 1.26 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q5_K_S.gguf | i1-Q5_K_S | 1.23 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.i1-Q6_K.gguf | i1-Q6_K | 1.42 GB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.imatrix.gguf | imatrix | 2.09 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 445 MB | Download |
| Qwen3-VL-2B-Instruct-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 819 MB | Download |
Qwen3-VL-2B-Thinking-abliterated-v1 [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VL-2B-Thinking-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 1.02 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q2_K.gguf | Q2_K | 778 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 1 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 940 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 867 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 1.11 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 1.06 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 1.26 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 1.23 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q6_K.gguf | Q6_K | 1.42 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.Q8_0.gguf | Q8_0 | 1.83 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.f16.gguf | F16 | 3.45 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ1_M.gguf | i1-IQ1_M | 544 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ1_S.gguf | i1-IQ1_S | 516 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ2_M.gguf | i1-IQ2_M | 695 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ2_S.gguf | i1-IQ2_S | 658 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ2_XS.gguf | i1-IQ2_XS | 632 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 590 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ3_M.gguf | i1-IQ3_M | 896 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ3_S.gguf | i1-IQ3_S | 867 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ3_XS.gguf | i1-IQ3_XS | 834 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 754 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ4_NL.gguf | i1-IQ4_NL | 1.05 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-IQ4_XS.gguf | i1-IQ4_XS | 1.01 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q2_K.gguf | i1-Q2_K | 778 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q2_K_S.gguf | i1-Q2_K_S | 733 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q3_K_L.gguf | i1-Q3_K_L | 1 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q3_K_M.gguf | i1-Q3_K_M | 940 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q3_K_S.gguf | i1-Q3_K_S | 867 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q4_0.gguf | i1-Q4_0 | 1.06 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q4_1.gguf | i1-Q4_1 | 1.14 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q4_K_M.gguf | i1-Q4_K_M | 1.11 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q4_K_S.gguf | i1-Q4_K_S | 1.06 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q5_K_M.gguf | i1-Q5_K_M | 1.26 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q5_K_S.gguf | i1-Q5_K_S | 1.23 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.i1-Q6_K.gguf | i1-Q6_K | 1.42 GB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.imatrix.gguf | imatrix | 2.09 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 445 MB | Download |
| Qwen3-VL-2B-Thinking-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 819 MB | Download |
Base Model Path
prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v1
prithivMLmods/Qwen3-VL-8B-Thinking-abliterated-v1
prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1
prithivMLmods/Qwen3-VL-4B-Thinking-abliterated-v1
prithivMLmods/Qwen3-VL-2B-Instruct-abliterated-v1
prithivMLmods/Qwen3-VL-2B-Thinking-abliterated-v1
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
- Downloads last month
- 24,089
Hardware compatibility
Log In
to view the estimation
Model tree for prithivMLmods/Qwen3-VL-abliterated-AIO-GGUF
Base model
Qwen/Qwen3-VL-2B-Instruct