Endpoints

Inference Catalog

100 items
Author avatar
sentence-transformers /

all-MiniLM-L6-v2

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 1x Intel Sapphire Rapids
$ 0.033
/ hour
Author avatar
sentence-transformers /

all-mpnet-base-v2

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
/ hour
Author avatar
Linaqruf /

animagine-xl-2.0

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
stablediffusionapi /

anything-v5

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
facebook /

bart-large-cnn

Summarization
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
facebook /

bart-large-mnli

Zero Shot Classification
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
BAAI /

bge-base-en-v1.5

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
BAAI /

bge-large-en-v1.5

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
MoritzLaurer /

bge-m3-zeroshot-v2.0

Zero Shot Classification
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
BAAI /

bge-multilingual-gemma2

Sentence Embeddings
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
BAAI /

bge-reranker-base

Sentence Ranking
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
MoritzLaurer /

deberta-v3-large-zeroshot-v2.0

Zero Shot Classification
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
deepseek-ai /

DeepSeek-R1-Distill-Llama-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
deepseek-ai /

DeepSeek-R1-Distill-Qwen-32B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
unsloth /

DeepSeek-R1-GGUF

Text Generation
Quantization: IQ1_S
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
unsloth /

DeepSeek-R1-GGUF

Text Generation
Quantization: IQ2_XXS
GPU 8x Nvidia L40S
$ 23.5
/ hour
Author avatar
distil-whisper /

distil-large-v2

Automatic Speech Recognition
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
distil-whisper /

distil-large-v3

Automatic Speech Recognition
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
llmrails /

ember-v1

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
black-forest-labs /

FLUX.1-schnell

Text-to-Image
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

gemma-3-12b-it

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

gemma-3-27b-it

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
ibm-granite /

granite-3.1-8b-base

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
thenlper /

gte-large

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
/ hour
Author avatar
thenlper /

gte-large-zh

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
/ hour
Author avatar
beethogedeon /

gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Sentence Embeddings
Quantization: Q4_K_M
CPU 8x Intel Sapphire Rapids
$ 0.268
/ hour
Author avatar
jinaai /

jina-embeddings-v2-base-en

Feature Extraction
TEI
Accelerated Text Embeddings Inference
CPU 1x Intel Sapphire Rapids
$ 0.033
/ hour
Author avatar
ggml-org /

jina-reranker-v1-turbo-en-GGUF

Sentence Ranking
Quantization: F16
CPU 8x Intel Sapphire Rapids
$ 0.268
/ hour
Author avatar
meta-llama /

Llama-2-13b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-13b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-70b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-2-70b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-2-7b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-7b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-3.1-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-3.1-70B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-3.1-8B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.1-8B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-11B-Vision-Instruct

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-3.2-1B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-1B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-3B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-3B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
lmstudio-community /

Llama-3.3-70B-Instruct-GGUF

Text Generation
Quantization: Q8_0
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
llava-hf /

llava-v1.6-vicuna-13b-hf

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Meta-Llama-3-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
meta-llama /

Meta-Llama-3-70B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
meta-llama /

Meta-Llama-3-8B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Meta-Llama-3-8B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-Instruct-v0.3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-v0.3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-Nemo-Instruct-2407

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
mistralai /

Mistral-Small-24B-Instruct-2501

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
mistralai /

Mixtral-8x22B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 8x Nvidia L40S
$ 23.5
/ hour
Author avatar
mistralai /

Mixtral-8x7B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
mistralai /

Mixtral-8x7B-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
cross-encoder /

ms-marco-MiniLM-L-12-v2

Sentence Ranking
CPU 1x Intel Sapphire Rapids
$ 0.033
/ hour
Author avatar
intfloat /

multilingual-e5-large

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
intfloat /

multilingual-e5-large-instruct

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
mixedbread-ai /

mxbai-embed-large-v1

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Intel /

neural-chat-7b-v3-1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Intel /

neural-chat-7b-v3-3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
openchat /

openchat-3.5-0106

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
prompthero /

openjourney

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
google /

paligemma2-10b-mix-224

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

paligemma2-10b-mix-448

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

paligemma2-3b-mix-448

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
sentence-transformers /

paraphrase-multilingual-MiniLM-L12-v2

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
microsoft /

Phi-3-mini-128k-instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
microsoft /

Phi-3-mini-4k-instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
microsoft /

phi-4

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-14B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Qwen /

Qwen2.5-14B-Instruct-1M

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Qwen /

Qwen2.5-72B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
Qwen /

Qwen2.5-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-14B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-32B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
bartowski /

Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation
Quantization: Q4_K_M
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-Math-72B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
Qwen /

Qwen2.5-Math-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-VL-7B-Instruct

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

QwQ-32B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
bartowski /

QwQ-32B-Preview-GGUF

Text Generation
Quantization: Q8_0
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
RekaAI /

reka-flash-3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
simplescaling /

s1.1-32B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
stabilityai /

sdxl-turbo

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
sentence-transformers /

sentence-t5-xxl

Sentence Embeddings
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
HuggingFaceTB /

SmolLM2-1.7B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
HuggingFaceTB /

SmolLM2-1.7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
stabilityai /

stable-diffusion-2-1

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
stable-diffusion-v1-5 /

stable-diffusion-v1-5

Text-to-Image
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
stabilityai /

stable-diffusion-xl-base-1.0

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
berkeley-nest /

Starling-LM-7B-alpha

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
qihoo360 /

TinyR1-32B-Preview

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
bytedance-research /

UI-TARS-72B-DPO

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 8x Nvidia L40S
$ 23.5
/ hour
Author avatar
lmsys /

vicuna-7b-v1.5

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
openai /

whisper-large-v3

Automatic Speech Recognition
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
openai /

whisper-large-v3-turbo

Automatic Speech Recognition
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
huggingFaceH4 /

zephyr-7b-beta

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour