Model Catalog
21 itemsggml-org /
gemma-4-26B-A4B-it-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
unsloth /
Qwen3.5-9B-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia T4
$ 0.5
unsloth /
Qwen3.5-35B-A3B-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
unsloth /
Qwen3.5-397B-A17B-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
MXFP4_MOE
GPU 2x Nvidia H200
$ 10
unsloth /
Qwen3-Coder-Next-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia A100
$ 2.5
unsloth /
MiniMax-M2.1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia H200
$ 5
unsloth /
GLM-4.7-Flash-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Embedding-8B-GGUF
Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Qwen /
Qwen3-Embedding-4B-GGUF
Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Qwen /
Qwen3-Embedding-0.6B-GGUF
Feature Extraction
Llama.cpp
Accelerated llama.cpp
F16
CPU 2x Intel Sapphire Rapids
$ 0.067
unsloth /
DeepSeek-R1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
UD-IQ2_XXS
GPU 4x Nvidia H200
$ 20
ggml-org /
InternVL3-14B-Instruct-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L4
$ 0.8
ggml-org /
Qwen2.5-VL-3B-Instruct-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
ggml-org /
Qwen2.5-VL-7B-Instruct-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
ggml-org /
SmolVLM2-2.2B-Instruct-GGUF
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
F16
GPU 1x Nvidia T4
$ 0.5
ggml-org /
jina-reranker-v1-turbo-en-GGUF
Text Ranking
Llama.cpp
Accelerated llama.cpp
F16
CPU 8x Intel Sapphire Rapids
$ 0.268
beethogedeon /
gte-Qwen2-7B-instruct-Q4_K_M-GGUF
Sentence Embeddings
Llama.cpp
Accelerated llama.cpp
Q4_K_M
CPU 8x Intel Sapphire Rapids
$ 0.268
bartowski /
QwQ-32B-Preview-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L40S
$ 1.8
bartowski /
Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
lmstudio-community /
Llama-3.3-70B-Instruct-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 4x Nvidia L4
$ 3.8
unsloth /
DeepSeek-R1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
UD-IQ1_S
GPU 4x Nvidia L40S
$ 8.3