Model Catalog
7 items
unsloth /
DeepSeek-R1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ1_S
GPU 4x Nvidia L40S
$ 8.3
unsloth /
DeepSeek-R1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ2_XXS
GPU 8x Nvidia L40S
$ 23.5
beethogedeon /
gte-Qwen2-7B-instruct-Q4_K_M-GGUF
Sentence Embeddings
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia T4
$ 0.5
ggml-org /
jina-reranker-v1-turbo-en-GGUF
Sentence Ranking
Llama.cpp
Accelerated llama.cpp
F16
GPU 1x Nvidia T4
$ 0.5
lmstudio-community /
Llama-3.3-70B-Instruct-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 4x Nvidia L4
$ 3.8
bartowski /
Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
bartowski /
QwQ-32B-Preview-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L40S
$ 1.8