GGUForge
Collection
3 items • Updated • 1
How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:# Run inference directly in the terminal:
llama cli -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:# Run inference directly in the terminal:
./llama-cli -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:# Run inference directly in the terminal:
./build/bin/llama-cli -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:Use Docker
docker model run hf.co/Akicou/MiniMax-M2.1-REAP-50-GGUF:Quick Links
MiniMax-M2.1-REAP-50-GGUF
This model was converted to GGUF format from 0xSero/MiniMax-M2.1-REAP-50 using GGUF Forge.
Quants
The following quants are available: Q2_K, Q3_K_S, Q3_K_M, Q3_K_L, Q4_0, Q4_K_S, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0
Conversion Stats
| Metric | Value |
|---|---|
| Job ID | 4596f6bc-436e-4b0a-a3a7-79e337824543 |
| GGUF Forge Version | v3.6 |
| Total Time | 5.1h |
| Avg Time per Quant | 13.2min |
Step Breakdown
- Download: 18.7min
- FP16 Conversion: 20.9min
- Quantization: 4.4h
🚀 Convert Your Own Models
Want to convert more models to GGUF?
👉 gguforge.com — Free hosted GGUF conversion service. Login with HuggingFace and request conversions instantly!
Links
- 🌐 Free Hosted Service: gguforge.com
- 🛠️ Self-host GGUF Forge: GitHub
- 📦 llama.cpp (quantization engine): GitHub
- 💬 Community & Support: Discord
Converted automatically by GGUF Forge v3.6
- Downloads last month
- 404
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf Akicou/MiniMax-M2.1-REAP-50-GGUF:# Run inference directly in the terminal: llama cli -hf Akicou/MiniMax-M2.1-REAP-50-GGUF: