Inference Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Ranking Zero Shot Classification Automatic Speech Recognition Summarization Feature Extraction

Price $ 0 - 50 / hour

Hardware Accelerator

ALL CPU GPU INF2 TPU

Inference Server

All Llama.cpp TEI TGI

License

Hub Models

Browse All Models

11 items

Sentence Embeddings

Clear All

sentence-transformers /

all-MiniLM-L6-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 1x Intel Sapphire Rapids

$ 0.033

/ hour

sentence-transformers /

all-mpnet-base-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

BAAI /

bge-base-en-v1.5

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

BAAI /

bge-large-en-v1.5

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

GPU 1x Nvidia L4

$ 0.8

/ hour

llmrails /

ember-v1

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

thenlper /

gte-large

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

thenlper /

gte-large-zh

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

intfloat /

multilingual-e5-large

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

GPU 1x Nvidia T4

$ 0.5

/ hour

intfloat /

multilingual-e5-large-instruct

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

GPU 1x Nvidia T4

$ 0.5

/ hour

mixedbread-ai /

mxbai-embed-large-v1

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

GPU 1x Nvidia L4

$ 0.8

/ hour

sentence-transformers /

paraphrase-multilingual-MiniLM-L12-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

GPU 1x Nvidia L4

$ 0.8

/ hour