Inference Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Ranking Zero Shot Classification Automatic Speech Recognition Summarization Feature Extraction

Price $ 0 - 50 / hour

Hardware Accelerator

ALL CPU GPU INF2 TPU

Inference Server

All Llama.cpp TEI TGI

License

Hub Models

Browse All Models

7 items

CPU Sentence Embeddings

Clear All

sentence-transformers /

all-MiniLM-L6-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 1x Intel Sapphire Rapids

$ 0.033

/ hour

sentence-transformers /

all-mpnet-base-v2

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

BAAI /

bge-base-en-v1.5

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

llmrails /

ember-v1

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 4x Intel Sapphire Rapids

$ 0.134

/ hour

thenlper /

gte-large

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

thenlper /

gte-large-zh

Sentence Embeddings

TEI

Accelerated Text Embeddings Inference

CPU 2x Intel Sapphire Rapids

$ 0.067

/ hour

beethogedeon /

gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Sentence Embeddings

Quantization: Q4_K_M

CPU 8x Intel Sapphire Rapids

$ 0.268

/ hour