Inference Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Ranking Zero Shot Classification Automatic Speech Recognition Summarization Feature Extraction

Price $ 0 - 50 / hour

Hardware Accelerator

ALL CPU GPU INF2 TPU

Inference Server

All Llama.cpp TEI TGI

License

Hub Models

Browse All Models

11 items

CPU

Clear All

sentence-transformers /

all-MiniLM-L6-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 1x Intel Sapphire Rapids

$ 0.033

/ hour

sentence-transformers /

all-mpnet-base-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

BAAI /

bge-base-en-v1.5

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

llmrails /

ember-v1

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

thenlper /

gte-large

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

thenlper /

gte-large-zh

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

jinaai /

jina-embeddings-v2-base-en

Feature Extraction

TEI

Accelerated Text Embeddings Inference

CPU 1x Intel Sapphire Rapids

$ 0.033

/ hour

cross-encoder /

ms-marco-MiniLM-L-12-v2

Sentence Ranking

CPU 1x Intel Sapphire Rapids

$ 0.033

/ hour

princeton-nlp /

Sheared-LLaMA-1.3B

Text Generation

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

HuggingFaceTB /

SmolLM2-1.7B

Text Generation

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

HuggingFaceTB /

SmolLM2-1.7B-Instruct

Text Generation

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour