Model Catalog
43 items
Applied Filters
ibm-granite /
granite-3.3-8b-instruct-FP8
10
Deployed 10 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
openai /
gpt-oss-safeguard-20b
23
Deployed 23 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
ibm-granite /
granite-4.0-micro
42
Deployed 42 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Next-80B-A3B-Instruct
27
Deployed 27 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Qwen /
Qwen3-Next-80B-A3B-Thinking
12
Deployed 12 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
swiss-ai /
Apertus-8B-Instruct-2509
42
Deployed 42 times
Text Generation
SGLang
Accelerated SGLang
GPU 1x Nvidia L4
$ 0.8
openai /
gpt-oss-120b
250
Deployed 250 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia H100
$ 9
openai /
gpt-oss-20b
376
Deployed 376 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia H100
$ 4.5
Qwen /
Qwen3-32B
80
Deployed 80 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
ibm-granite /
granite-3.3-8b-instruct
22
Deployed 22 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
HuggingFaceTB /
SmolLM3-3B
28
Deployed 28 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-1.7B
106
Deployed 106 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
unsloth /
DeepSeek-R1-GGUF
42
Deployed 42 times
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ2_XXS
GPU 8x Nvidia A100
$ 20
bartowski /
QwQ-32B-Preview-GGUF
4
Deployed 4 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-7B-Instruct
235
Deployed 235 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
HuggingFaceH4 /
zephyr-7b-beta
52
Deployed 52 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mistral-Small-24B-Instruct-2501
52
Deployed 52 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia L4
$ 3.8
meta-llama /
Llama-3.1-8B-Instruct
432
Deployed 432 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
microsoft /
Phi-3-mini-128k-instruct
80
Deployed 80 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
mistralai /
Mistral-7B-Instruct-v0.3
365
Deployed 365 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
deepseek-ai /
DeepSeek-R1-Distill-Llama-70B
114
Deployed 114 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
openchat /
openchat-3.5-0106
31
Deployed 31 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
bartowski /
Qwen2.5-Coder-32B-Instruct-GGUF
56
Deployed 56 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen2.5-Coder-32B-Instruct
104
Deployed 104 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
meta-llama /
Meta-Llama-3-8B-Instruct
87
Deployed 87 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
microsoft /
Phi-3-mini-4k-instruct
61
Deployed 61 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Qwen /
QwQ-32B
59
Deployed 59 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
meta-llama /
Meta-Llama-3-70B-Instruct
8
Deployed 8 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
mistralai /
Mistral-Nemo-Instruct-2407
33
Deployed 33 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia L4
$ 3.8
microsoft /
phi-4
75
Deployed 75 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-14B-Instruct
137
Deployed 137 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen2.5-72B-Instruct
42
Deployed 42 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
mistralai /
Mixtral-8x22B-Instruct-v0.1
18
Deployed 18 times
Text Generation
vLLM
Accelerated vLLM
GPU 8x Nvidia A100
$ 20
meta-llama /
Llama-3.1-70B-Instruct
86
Deployed 86 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
HuggingFaceTB /
SmolLM2-1.7B-Instruct
47
Deployed 47 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen2.5-Coder-7B-Instruct
62
Deployed 62 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-3.2-3B-Instruct
118
Deployed 118 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
deepseek-ai /
DeepSeek-R1-Distill-Qwen-32B
136
Deployed 136 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen2.5-Coder-14B-Instruct
26
Deployed 26 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
lmstudio-community /
Llama-3.3-70B-Instruct-GGUF
57
Deployed 57 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 4x Nvidia L4
$ 3.8
meta-llama /
Llama-3.2-1B-Instruct
49
Deployed 49 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mixtral-8x7B-Instruct-v0.1
132
Deployed 132 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
unsloth /
DeepSeek-R1-GGUF
54
Deployed 54 times
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ1_S
GPU 4x Nvidia L40S
$ 8.3