Model Catalog
58 items
Applied Filters
deepseek-ai /
DeepSeek-R1-Distill-Llama-70B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
deepseek-ai /
DeepSeek-R1-Distill-Qwen-32B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
unsloth /
DeepSeek-R1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ1_S
GPU 4x Nvidia L40S
$ 8.3
unsloth /
DeepSeek-R1-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ2_XXS
GPU 8x Nvidia L40S
$ 23.5
ibm-granite /
granite-3.1-8b-base
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-13b-chat-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-13b-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-70b-chat-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Llama-2-70b-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Llama-2-7b-chat-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-2-7b-hf
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
meta-llama /
Llama-3.1-70B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Llama-3.1-70B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
meta-llama /
Llama-3.1-8B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.1-8B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.2-1B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.2-1B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.2-3B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Llama-3.2-3B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
lmstudio-community /
Llama-3.3-70B-Instruct-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 4x Nvidia L4
$ 3.8
meta-llama /
Meta-Llama-3-70B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
meta-llama /
Meta-Llama-3-70B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
meta-llama /
Meta-Llama-3-8B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
meta-llama /
Meta-Llama-3-8B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mistral-7B-Instruct-v0.3
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mistral-7B-v0.3
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
mistralai /
Mistral-Nemo-Instruct-2407
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
mistralai /
Mistral-Small-24B-Instruct-2501
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
mistralai /
Mixtral-8x22B-Instruct-v0.1
Text Generation
TGI
Accelerated Text Generation Inference
GPU 8x Nvidia L40S
$ 23.5
mistralai /
Mixtral-8x7B-Instruct-v0.1
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
mistralai /
Mixtral-8x7B-v0.1
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
Intel /
neural-chat-7b-v3-1
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
Intel /
neural-chat-7b-v3-3
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
openchat /
openchat-3.5-0106
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
microsoft /
Phi-3-mini-128k-instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
microsoft /
Phi-3-mini-4k-instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
microsoft /
phi-4
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-14B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
Qwen /
Qwen2.5-14B-Instruct-1M
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
Qwen /
Qwen2.5-72B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
Qwen /
Qwen2.5-7B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-Coder-14B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
Qwen /
Qwen2.5-Coder-32B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
bartowski /
Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen2.5-Coder-7B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-Math-72B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
Qwen /
Qwen2.5-Math-7B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
Qwen /
QwQ-32B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
bartowski /
QwQ-32B-Preview-GGUF
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L40S
$ 1.8
RekaAI /
reka-flash-3
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
simplescaling /
s1.1-32B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
HuggingFaceTB /
SmolLM2-1.7B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
HuggingFaceTB /
SmolLM2-1.7B-Instruct
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
berkeley-nest /
Starling-LM-7B-alpha
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
Tesslate /
Tessa-T1-32B
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
qihoo360 /
TinyR1-32B-Preview
Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
lmsys /
vicuna-7b-v1.5
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
HuggingFaceH4 /
zephyr-7b-beta
Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8