Model Catalog
Llama.cpp
Discover our curated LlamaCPP model collection, optimized for fast, lightweight inference on any device. Powered by LlamaCPP’s native C++ engine, each model runs without Python dependencies, delivering low‑latency responses even on modest CPUs or GPUs.
21 items
ggml-org
gemma-4-26B-A4B-it-GGUF
/
Q4_K_M
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
unsloth
Qwen3.5-9B-GGUF
/
Q4_K_M
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
unsloth
Qwen3.5-35B-A3B-GGUF
/
Q4_K_M
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
unsloth
Qwen3.5-397B-A17B-GGUF
/
MXFP4_MOE
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
unsloth
Qwen3-Coder-Next-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia A100
$ 2.5
unsloth
MiniMax-M2.1-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Modified MIT License
GPU 1x Nvidia H200
$ 5
unsloth
GLM-4.7-Flash-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
Qwen
Qwen3-Embedding-8B-GGUF
/
Q8_0
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
Qwen
Qwen3-Embedding-4B-GGUF
/
Q8_0
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
Qwen
Qwen3-Embedding-0.6B-GGUF
/
F16
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
unsloth
DeepSeek-R1-GGUF
/
UD-IQ2_XXS
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 4x Nvidia RTX PRO 6000 Blackwell
$ 11
ggml-org
InternVL3-14B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
ggml-org
Qwen2.5-VL-3B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
ggml-org
Qwen2.5-VL-7B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
ggml-org
SmolVLM2-2.2B-Instruct-GGUF
/
F16
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
ggml-org
jina-reranker-v1-turbo-en-GGUF
/
F16
LlamaCpp Quantization
Text Ranking
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
beethogedeon
gte-Qwen2-7B-instruct-Q4_K_M-GGUF
/
Q4_K_M
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
unsloth
DeepSeek-R1-GGUF
/
UD-IQ1_S
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 2x Nvidia RTX PRO 6000 Blackwell
$ 5.5
lmstudio-community
Llama-3.3-70B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Llama 3.3 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
bartowski
Qwen2.5-Coder-32B-Instruct-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
bartowski
QwQ-32B-Preview-GGUF
/
Q8_0
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8