Model Catalog
All Models
Explore curated open-source models and deploy them as dedicated inference endpoints in
minutes. Filter by task, framework, or hardware to find the right fit — then go from model
to production with a single click.
111 items
nvidia
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
Text Generation
vLLM Engine
OpenMDW-1.1 License
GPU 8x Nvidia RTX PRO 6000 Blackwell
$ 22
nvidia
GLM-5.2-NVFP4
Text Generation
Default Engine
MIT License
GPU 8x Nvidia RTX PRO 6000 Blackwell
$ 22
google
gemma-4-12B-it
Any-to-Any
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Qwen
Qwen3.6-35B-A3B-FP8
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Qwen
Qwen3.6-27B-FP8
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
ggml-org
gemma-4-26B-A4B-it-GGUF
/
Q4_K_M
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
google
gemma-4-31B-it
Deployed 179 times
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
google
gemma-4-26B-A4B-it
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
unsloth
Qwen3.5-9B-GGUF
/
Q4_K_M
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
unsloth
Qwen3.5-35B-A3B-GGUF
/
Q4_K_M
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
mistralai
Mistral-Small-4-119B-2603
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
MiniMaxAI
MiniMax-M2.5
Text Generation
vLLM Engine
Modified MIT License
GPU 4x Nvidia A100
$ 10
zai-org
GLM-5-FP8
Text Generation
vLLM Engine
MIT License
GPU 8x Nvidia H200
$ 40
unsloth
Qwen3.5-397B-A17B-GGUF
/
MXFP4_MOE
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
unsloth
Qwen3-Coder-Next-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia A100
$ 2.5
MiniMaxAI
MiniMax-M2.1
Text Generation
vLLM Engine
Modified MIT License
GPU 4x Nvidia A100
$ 10
unsloth
MiniMax-M2.1-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Modified MIT License
GPU 1x Nvidia H200
$ 5
unsloth
GLM-4.7-Flash-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
mistralai
Devstral-Small-2-24B-Instruct-2512
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
ibm-granite
granite-3.3-8b-instruct-FP8
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
openai
gpt-oss-safeguard-20b
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
allenai
olmOCR-2-7B-1025-FP8
Deployed 228 times
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Qwen
Qwen3-VL-30B-A3B-Thinking
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
Qwen
Qwen3-VL-8B-Instruct
Deployed 194 times
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia A100
$ 2.5
lightonai
LightOnOCR-1B-1025
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
deepseek-ai
DeepSeek-OCR
Deployed 209 times
Image-Text-to-Text
vLLM Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
zai-org
GLM-4.1V-9B-Thinking
Image-Text-to-Text
vLLM Engine
MIT License
GPU 1x Nvidia A100
$ 2.5
ServiceNow-AI
Apriel-1.5-15b-Thinker
Image-Text-to-Text
vLLM Engine
MIT License
GPU 1x Nvidia H200
$ 5
rednote-hilab
dots.ocr
Image-Text-to-Text
vLLM Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
nanonets
Nanonets-OCR-s
Image-Text-to-Text
vLLM Engine
MIT License
GPU 1x Nvidia L40S
$ 1.8
Qwen
Qwen3-Embedding-8B-GGUF
/
Q8_0
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
Qwen
Qwen3-Embedding-4B-GGUF
/
Q8_0
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
Qwen
Qwen3-Embedding-0.6B-GGUF
/
F16
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
CPU 2x Intel Sapphire Rapids
$ 0.067
ibm-granite
granite-4.0-micro
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Qwen
Qwen3-Next-80B-A3B-Instruct
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
Qwen
Qwen3-Next-80B-A3B-Thinking
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia H200
$ 10
google
embeddinggemma-300m
Sentence Similarity
TEI Engine
Gemma License
CPU 2x Intel Sapphire Rapids
$ 0.067
onnx-community
embeddinggemma-300m-ONNX
Sentence Similarity
TEI Engine
Gemma License
CPU 2x Intel Sapphire Rapids
$ 0.067
openai
gpt-oss-120b
Deployed 354 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia RTX PRO 6000 Blackwell
$ 5.5
openai
gpt-oss-20b
Deployed 487 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Qwen
Qwen3-32B
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
ibm-granite
granite-3.3-8b-instruct
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
Qwen
Qwen3-Embedding-0.6B
Deployed 195 times
Feature Extraction
TEI Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Qwen
Qwen3-Embedding-4B
Feature Extraction
TEI Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Qwen
Qwen3-Embedding-8B
Deployed 341 times
Feature Extraction
TEI Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
nomic-ai
nomic-embed-text-v1.5
Sentence Similarity
TEI Engine
Apache 2.0 License
CPU 8x Intel Sapphire Rapids
$ 0.268
HuggingFaceTB
SmolLM3-3B
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Qwen
Qwen3-1.7B
Deployed 165 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
unsloth
DeepSeek-R1-GGUF
/
UD-IQ2_XXS
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 4x Nvidia RTX PRO 6000 Blackwell
$ 11
ggml-org
InternVL3-14B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
ggml-org
Qwen2.5-VL-3B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
ggml-org
Qwen2.5-VL-7B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
ggml-org
SmolVLM2-2.2B-Instruct-GGUF
/
F16
LlamaCpp Quantization
Image-Text-to-Text
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia T4
$ 0.5
BAAI
bge-multilingual-gemma2
Feature Extraction
Default Engine
Gemma License
GPU 1x Nvidia L40S
$ 1.8
ggml-org
jina-reranker-v1-turbo-en-GGUF
/
F16
LlamaCpp Quantization
Text Ranking
Llama.cpp Engine
Apache 2.0 License
CPU 8x Intel Sapphire Rapids
$ 0.268
cross-encoder
ms-marco-MiniLM-L12-v2
Text Ranking
Default Engine
Apache 2.0 License
CPU 1x Intel Sapphire Rapids
$ 0.033
BAAI
bge-reranker-base
Text Ranking
TEI Engine
MIT License
GPU 1x Nvidia T4
$ 0.5
stablediffusionapi
anything-v5
Text-to-Image
Default Engine
CreativeML Open RAIL-M License
GPU 1x Nvidia L4
$ 0.8
stable-diffusion-v1-5
stable-diffusion-v1-5
Text-to-Image
Default Engine
CreativeML Open RAIL-M License
GPU 1x Nvidia T4
$ 0.5
stabilityai
stable-diffusion-xl-base-1.0
Deployed 161 times
Text-to-Image
Default Engine
OpenRAIL++ License
GPU 1x Nvidia L4
$ 0.8
prompthero
openjourney
Text-to-Image
Default Engine
CreativeML Open RAIL-M License
GPU 1x Nvidia L4
$ 0.8
Linaqruf
animagine-xl-2.0
Text-to-Image
Default Engine
OpenRAIL++ License
GPU 1x Nvidia L4
$ 0.8
black-forest-labs
FLUX.1-schnell
Deployed 219 times
Text-to-Image
Default Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
thenlper
gte-large
Feature Extraction
TEI Engine
MIT License
CPU 4x Intel Sapphire Rapids
$ 0.134
sentence-transformers
paraphrase-multilingual-MiniLM-L12-v2
Feature Extraction
TEI Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
sentence-transformers
all-mpnet-base-v2
Feature Extraction
TEI Engine
Apache 2.0 License
CPU 2x Intel Sapphire Rapids
$ 0.067
sentence-transformers
all-MiniLM-L6-v2
Deployed 418 times
Feature Extraction
TEI Engine
Apache 2.0 License
CPU 1x Intel Sapphire Rapids
$ 0.033
mixedbread-ai
mxbai-embed-large-v1
Feature Extraction
TEI Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
intfloat
multilingual-e5-large-instruct
Feature Extraction
TEI Engine
MIT License
GPU 1x Nvidia T4
$ 0.5
intfloat
multilingual-e5-large
Feature Extraction
TEI Engine
MIT License
GPU 1x Nvidia T4
$ 0.5
beethogedeon
gte-Qwen2-7B-instruct-Q4_K_M-GGUF
/
Q4_K_M
LlamaCpp Quantization
Feature Extraction
Llama.cpp Engine
Apache 2.0 License
CPU 8x Intel Sapphire Rapids
$ 0.268
BAAI
bge-large-en-v1.5
Feature Extraction
TEI Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
BAAI
bge-base-en-v1.5
Feature Extraction
TEI Engine
MIT License
CPU 4x Intel Sapphire Rapids
$ 0.134
Qwen
Qwen2.5-VL-7B-Instruct
Deployed 310 times
Image-Text-to-Text
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia A100
$ 2.5
google
paligemma2-10b-mix-448
Image-Text-to-Text
vLLM Engine
Gemma License
GPU 1x Nvidia L40S
$ 1.8
google
paligemma2-10b-mix-224
Image-Text-to-Text
vLLM Engine
Gemma License
GPU 1x Nvidia L40S
$ 1.8
google
paligemma2-3b-mix-448
Image-Text-to-Text
vLLM Engine
Gemma License
GPU 1x Nvidia L4
$ 0.8
google
gemma-3-12b-it
Deployed 264 times
Image-Text-to-Text
vLLM Engine
Gemma License
GPU 1x Nvidia L40S
$ 1.8
google
gemma-3-27b-it
Deployed 312 times
Image-Text-to-Text
vLLM Engine
Gemma License
GPU 1x Nvidia A100
$ 2.5
openai
whisper-large-v3-turbo
Deployed 242 times
Automatic Speech Recognition
Default Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
openai
whisper-large-v3
Deployed 236 times
Automatic Speech Recognition
Default Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
meta-llama
Llama-3.1-8B-Instruct
Deployed 555 times
Text Generation
vLLM Engine
Llama 3.1 License
GPU 1x Nvidia A100
$ 2.5
mistralai
Mistral-7B-Instruct-v0.3
Deployed 511 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
Qwen
Qwen2.5-Coder-32B-Instruct
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
Qwen
Qwen2.5-Coder-7B-Instruct
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
meta-llama
Llama-3.1-70B-Instruct
Text Generation
vLLM Engine
Llama 3.1 License
GPU 4x Nvidia A100
$ 10
meta-llama
Meta-Llama-3-8B-Instruct
Text Generation
vLLM Engine
Llama 3 License
GPU 1x Nvidia A100
$ 2.5
microsoft
Phi-3-mini-128k-instruct
Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia A100
$ 2.5
microsoft
Phi-3-mini-4k-instruct
Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
microsoft
phi-4
Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia L40S
$ 1.8
Qwen
QwQ-32B
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
mistralai
Mistral-Nemo-Instruct-2407
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Qwen
Qwen2.5-7B-Instruct
Deployed 372 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
meta-llama
Meta-Llama-3-70B-Instruct
Text Generation
vLLM Engine
Llama 3 License
GPU 4x Nvidia A100
$ 10
mistralai
Mistral-Small-24B-Instruct-2501
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Qwen
Qwen2.5-72B-Instruct
Text Generation
vLLM Engine
Apache 2.0 License
GPU 4x Nvidia A100
$ 10
HuggingFaceH4
zephyr-7b-beta
Text Generation
vLLM Engine
MIT License
GPU 1x Nvidia L4
$ 0.8
HuggingFaceTB
SmolLM2-1.7B-Instruct
Text Generation
vLLM Engine
Llama 2 License
GPU 1x Nvidia L4
$ 0.8
deepseek-ai
DeepSeek-R1-Distill-Llama-70B
Text Generation
vLLM Engine
MIT License
GPU 4x Nvidia A100
$ 10
Qwen
Qwen2.5-14B-Instruct
Deployed 183 times
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia H200
$ 5
mistralai
Mixtral-8x22B-Instruct-v0.1
Text Generation
vLLM Engine
Apache 2.0 License
GPU 4x Nvidia RTX PRO 6000 Blackwell
$ 11
bartowski
QwQ-32B-Preview-GGUF
/
Q8_0
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
openchat
openchat-3.5-0106
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
bartowski
Qwen2.5-Coder-32B-Instruct-GGUF
/
Q4_K_M
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Apache 2.0 License
GPU 1x Nvidia L4
$ 0.8
lmstudio-community
Llama-3.3-70B-Instruct-GGUF
/
Q8_0
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
Llama 3.3 License
GPU 1x Nvidia RTX PRO 6000 Blackwell
$ 2.75
Qwen
Qwen2.5-Coder-14B-Instruct
Text Generation
vLLM Engine
Apache 2.0 License
GPU 1x Nvidia L40S
$ 1.8
mistralai
Mixtral-8x7B-Instruct-v0.1
Text Generation
vLLM Engine
Apache 2.0 License
GPU 2x Nvidia A100
$ 5
meta-llama
Llama-3.2-3B-Instruct
Deployed 159 times
Text Generation
vLLM Engine
Llama 3.2 License
GPU 1x Nvidia L40S
$ 1.8
deepseek-ai
DeepSeek-R1-Distill-Qwen-32B
Deployed 168 times
Text Generation
vLLM Engine
MIT License
GPU 2x Nvidia A100
$ 5
meta-llama
Llama-3.2-1B-Instruct
Text Generation
vLLM Engine
Llama 3.2 License
GPU 1x Nvidia L4
$ 0.8
unsloth
DeepSeek-R1-GGUF
/
UD-IQ1_S
LlamaCpp Quantization
Text Generation
Llama.cpp Engine
MIT License
GPU 2x Nvidia RTX PRO 6000 Blackwell
$ 5.5