Inference Providers
Active filters: nncf
AIFunOver/Qwen2.5-7B-Instruct-openvino-8bit
Text Generation • Updated • 19
AIFunOver/Qwen2.5-7B-Instruct-openvino-fp16
Text Generation • Updated • 30
AIFunOver/Qwen2.5-7B-Instruct-openvino-4bit
Text Generation • Updated • 12
AIFunOver/Llama-3.2-1B-Instruct-openvino-8bit
Text Generation • Updated • 32
AIFunOver/Llama-3.2-1B-Instruct-openvino-fp16
Text Generation • Updated • 32
AIFunOver/Llama-3.2-1B-Instruct-openvino-4bit
Text Generation • Updated • 30
• 1
AIFunOver/Llama-3.2-3B-Instruct-openvino-8bit
Text Generation • Updated • 34
• 1
AIFunOver/Llama-3.2-3B-Instruct-openvino-fp16
Text Generation • Updated • 28
AIFunOver/Llama-3.2-3B-Instruct-openvino-4bit
Text Generation • Updated • 37
AIFunOver/Llama-3.1-8B-Instruct-openvino-8bit
Text Generation • Updated • 35
AIFunOver/Llama-3.1-8B-Instruct-openvino-fp16
Text Generation • Updated • 35
AIFunOver/Llama-3.1-8B-Instruct-openvino-4bit
Text Generation • Updated • 32
AIFunOver/Llama-2-7b-hf-openvino-8bit
Text Generation • Updated • 31
• 1
AIFunOver/Llama-2-7b-hf-openvino-fp16
Text Generation • Updated • 27
AIFunOver/Llama-2-7b-hf-openvino-4bit
Text Generation • Updated • 32
• 1
AIFunOver/Llama-2-13b-hf-openvino-8bit
Text Generation • Updated • 35
AIFunOver/Llama-2-13b-hf-openvino-fp16
Text Generation • Updated • 27
NikolayKozloff/MKLLM-7B-Instruct-openvino-4bit
Updated • 25
• 1
NikolayKozloff/MKLLM-7B-Instruct-openvino-8bit
Updated • 19
• 1
AIFunOver/Llama-2-13b-hf-openvino-4bit
Text Generation • Updated • 37
AIFunOver/Qwen2.5-Coder-7B-Instruct-openvino-8bit
Text Generation • Updated • 16
AIFunOver/Qwen2.5-Coder-7B-Instruct-openvino-fp16
Text Generation • Updated • 42
• 1
AIFunOver/Qwen2.5-Coder-7B-Instruct-openvino-4bit
Text Generation • Updated • 18
AIFunOver/Qwen2.5-1.5B-Instruct-openvino-8bit
Text Generation • Updated • 31
AIFunOver/Qwen2.5-1.5B-Instruct-openvino-fp16
Text Generation • Updated • 35
AIFunOver/Qwen2.5-1.5B-Instruct-openvino-4bit
Text Generation • Updated • 22
AIFunOver/stable-diffusion-v1-5-openvino-fp16
Text-to-Image • Updated AIFunOver/sdxl-turbo-openvino-8bit
Text-to-Image • Updated AIFunOver/sdxl-turbo-openvino-fp16
Text-to-Image • Updated AIFunOver/FLUX.1-dev-openvino-fp16
Text-to-Image • Updated