Model Catalog

Text Generation
52 items
Author avatar
nvidia

NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Text Generation
vLLM Engine
OpenMDW-1.1 License
GPU 8x Nvidia RTX PRO 6000 Blackwell
$ 22
Author avatar
nvidia

GLM-5.2-NVFP4

Text Generation
Default Engine
MIT License
GPU 8x Nvidia RTX PRO 6000 Blackwell
$ 22
Author avatar
mistralai

Mistral-Small-4-119B-2603

Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
Author avatar
MiniMaxAI

MiniMax-M2.5

Text Generation
vLLM Engine
Modified MIT License
GPU 4x Nvidia A100
$ 10
Author avatar
zai-org

GLM-5-FP8

Text Generation
vLLM Engine
MIT License
GPU 8x Nvidia H200
$ 40
Author avatar
unsloth

Qwen3-Coder-Next-GGUF

/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia A100
$ 2.5
Author avatar
MiniMaxAI

MiniMax-M2.1

Text Generation
vLLM Engine
Modified MIT License
GPU 4x Nvidia A100
$ 10
Author avatar
unsloth

MiniMax-M2.1-GGUF

/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Modified MIT License
GPU 1x Nvidia H200
$ 5
Author avatar
unsloth

GLM-4.7-Flash-GGUF

/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
Author avatar
mistralai

Devstral-Small-2-24B-Instruct-2512

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
Author avatar
ibm-granite

granite-3.3-8b-instruct-FP8

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
openai

gpt-oss-safeguard-20b

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
ibm-granite

granite-4.0-micro

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen

Qwen3-Next-80B-A3B-Instruct

Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
Author avatar
Qwen

Qwen3-Next-80B-A3B-Thinking

Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
Author avatar
openai

gpt-oss-120b

Deployed 354 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia RTX PRO 6000 Blackwell
$ 5.5
Author avatar
openai

gpt-oss-20b

Deployed 487 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Author avatar
Qwen

Qwen3-32B

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
Author avatar
ibm-granite

granite-3.3-8b-instruct

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
HuggingFaceTB

SmolLM3-3B

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen

Qwen3-1.7B

Deployed 165 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
unsloth

DeepSeek-R1-GGUF

/
UD-IQ2_XXS
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 4x Nvidia RTX PRO 6000 Blackwell
$ 11
Author avatar
meta-llama

Llama-3.1-8B-Instruct

Deployed 555 times
Text Generation
vLLM Engine
Llama 3.1 License
GPU 1x Nvidia A100
$ 2.5
Author avatar
mistralai

Mistral-7B-Instruct-v0.3

Deployed 511 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen

Qwen2.5-Coder-32B-Instruct

Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
Author avatar
Qwen

Qwen2.5-Coder-7B-Instruct

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
meta-llama

Llama-3.1-70B-Instruct

Text Generation
vLLM Engine
Llama 3.1 License
GPU 4x Nvidia A100
$ 10
Author avatar
meta-llama

Meta-Llama-3-8B-Instruct

Text Generation
vLLM Engine
Llama 3 License
GPU 1x Nvidia A100
$ 2.5
Author avatar
microsoft

Phi-3-mini-128k-instruct

Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia A100
$ 2.5
Author avatar
microsoft

Phi-3-mini-4k-instruct

Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
Author avatar
microsoft

phi-4

Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
Qwen

QwQ-32B

Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
Author avatar
mistralai

Mistral-Nemo-Instruct-2407

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Author avatar
Qwen

Qwen2.5-7B-Instruct

Deployed 372 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
meta-llama

Meta-Llama-3-70B-Instruct

Text Generation
vLLM Engine
Llama 3 License
GPU 4x Nvidia A100
$ 10
Author avatar
mistralai

Mistral-Small-24B-Instruct-2501

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Author avatar
Qwen

Qwen2.5-72B-Instruct

Text Generation
vLLM Engine
Apache 2.0 License
GPU 4x Nvidia A100
$ 10
Author avatar
HuggingFaceH4

zephyr-7b-beta

Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
Author avatar
HuggingFaceTB

SmolLM2-1.7B-Instruct

Text Generation
vLLM Engine
Llama 2 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
deepseek-ai

DeepSeek-R1-Distill-Llama-70B

Text Generation
vLLM Engine
MIT License
GPU 4x Nvidia A100
$ 10
Author avatar
Qwen

Qwen2.5-14B-Instruct

Deployed 183 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
Author avatar
mistralai

Mixtral-8x22B-Instruct-v0.1

Text Generation
vLLM Engine
Apache 2.0 License
GPU 4x Nvidia RTX PRO 6000 Blackwell
$ 11
Author avatar
bartowski

QwQ-32B-Preview-GGUF

/
Q8_0
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
openchat

openchat-3.5-0106

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
bartowski

Qwen2.5-Coder-32B-Instruct-GGUF

/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
lmstudio-community

Llama-3.3-70B-Instruct-GGUF

/
Q8_0
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Llama 3.3 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Author avatar
Qwen

Qwen2.5-Coder-14B-Instruct

Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
mistralai

Mixtral-8x7B-Instruct-v0.1

Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
Author avatar
meta-llama

Llama-3.2-3B-Instruct

Deployed 159 times
Text Generation
vLLM Engine
Llama 3.2 License
GPU 1x Nvidia L40S
$ 1.8
Author avatar
deepseek-ai

DeepSeek-R1-Distill-Qwen-32B

Deployed 168 times
Text Generation
vLLM Engine
MIT License
GPU 2x Nvidia A100
$ 5
Author avatar
meta-llama

Llama-3.2-1B-Instruct

Text Generation
vLLM Engine
Llama 3.2 License
GPU 1x Nvidia L4
$ 0.8
Author avatar
unsloth

DeepSeek-R1-GGUF

/
UD-IQ1_S
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 2x Nvidia RTX PRO 6000 Blackwell
$ 5.5