Endpoints

Inference Catalog

92 items
Author avatar
sentence-transformers /

all-MiniLM-L6-v2

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 1x Intel Sapphire Rapids
$ 0.033
/ hour
Author avatar
sentence-transformers /

all-mpnet-base-v2

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
/ hour
Author avatar
Linaqruf /

animagine-xl-2.0

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
stablediffusionapi /

anything-v5

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
facebook /

bart-large-cnn

Summarization
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
facebook /

bart-large-mnli

Zero Shot Classification
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
BAAI /

bge-base-en-v1.5

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
BAAI /

bge-large-en-v1.5

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
MoritzLaurer /

bge-m3-zeroshot-v2.0

Zero Shot Classification
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
BAAI /

bge-reranker-base

Sentence Ranking
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
MoritzLaurer /

deberta-v3-large-zeroshot-v2.0

Zero Shot Classification
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
distil-whisper /

distil-large-v2

Automatic Speech Recognition
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
distil-whisper /

distil-large-v3

Automatic Speech Recognition
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
llmrails /

ember-v1

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
TheBloke /

Falcon-180B-Chat-GPTQ

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
black-forest-labs /

FLUX.1-schnell

Text-to-Image
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

gemma-2-27b

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
google /

gemma-2-27b-it

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
google /

gemma-2-2b

Text Generation
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
google /

gemma-2-2b-it

Text Generation
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
google /

gemma-2-9b

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

gemma-2-9b-it

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

gemma-2b

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
google /

gemma-2b-it

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
google /

gemma-7b

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
google /

gemma-7b-it

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
thenlper /

gte-large

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
/ hour
Author avatar
thenlper /

gte-large-zh

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
CPU 2x Intel Sapphire Rapids
$ 0.067
/ hour
Author avatar
jinaai /

jina-embeddings-v2-base-en

Feature Extraction
TEI
Accelerated Text Embeddings Inference
CPU 1x Intel Sapphire Rapids
$ 0.033
/ hour
Author avatar
TheBloke /

Llama-2-13B-chat-GPTQ

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-2-13b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-13b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
TheBloke /

Llama-2-70B-chat-GPTQ

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
meta-llama /

Llama-2-70b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-2-70b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-2-7b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-7b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-3.1-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-3.1-70B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-3.1-8B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.1-8B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-11B-Vision-Instruct

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-1B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-1B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-3B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-3B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
lmstudio-community /

Llama-3.3-70B-Instruct-GGUF

Text Generation
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
meta-llama /

Meta-Llama-3-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
meta-llama /

Meta-Llama-3-70B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
meta-llama /

Meta-Llama-3-8B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Meta-Llama-3-8B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-Instruct-v0.2

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-Instruct-v0.3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-v0.2

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-v0.3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-Nemo-Instruct-2407

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
mistralai /

Mixtral-8x22B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 8x Nvidia L40S
$ 23.5
/ hour
Author avatar
mistralai /

Mixtral-8x7B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
mistralai /

Mixtral-8x7B-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
cross-encoder /

ms-marco-MiniLM-L-12-v2

Sentence Ranking
CPU 1x Intel Sapphire Rapids
$ 0.033
/ hour
Author avatar
intfloat /

multilingual-e5-large

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
intfloat /

multilingual-e5-large-instruct

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
mixedbread-ai /

mxbai-embed-large-v1

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Intel /

neural-chat-7b-v3-1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Intel /

neural-chat-7b-v3-3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
TheBloke /

NeuralHermes-2.5-Mistral-7B-GPTQ

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
allenai /

OLMo-7B-0724-Instruct-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
openchat /

openchat-3.5-0106

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
TheBloke /

OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
prompthero /

openjourney

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
sentence-transformers /

paraphrase-multilingual-MiniLM-L12-v2

Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Qwen /

Qwen2-72B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
Qwen /

Qwen2-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2-VL-7B-Instruct

Image-Text-to-Text
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-32B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
bartowski /

Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
bartowski /

QwQ-32B-Preview-GGUF

Text Generation
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
stabilityai /

sdxl-turbo

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
princeton-nlp /

Sheared-LLaMA-1.3B

Text Generation
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
HuggingFaceTB /

SmolLM2-1.7B

Text Generation
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
HuggingFaceTB /

SmolLM2-1.7B-Instruct

Text Generation
CPU 4x Intel Sapphire Rapids
$ 0.134
/ hour
Author avatar
stabilityai /

stable-diffusion-2-1

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
stable-diffusion-v1-5 /

stable-diffusion-v1-5

Text-to-Image
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
stabilityai /

stable-diffusion-xl-base-1.0

Text-to-Image
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
berkeley-nest /

Starling-LM-7B-alpha

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
lmsys /

vicuna-7b-v1.5

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
openai /

whisper-large-v3

Automatic Speech Recognition
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
openai /

whisper-large-v3-turbo

Automatic Speech Recognition
GPU 1x Nvidia T4
$ 0.5
/ hour
Author avatar
huggingFaceH4 /

zephyr-7b-beta

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour