Inference Catalog | Inference Endpoints by Hugging Face

Inference Endpoints

Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Similarity Text Ranking Automatic Speech Recognition Feature Extraction

Price $ 0 - 50 / hour

0
0.1
0.5
1
5
50

Inference Engine

All Llama.cpp TEI vLLM SGLang

Hardware Accelerator

ALL CPU GPU INF2

License

Hub Models

Browse All Models

Model Catalog

1 items

Applied Filters

LLAMACPP Sentence Embeddings Clear All

gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Deployed 22 times

Sentence Embeddings

Accelerated llama.cpp

CPU 8x Intel Sapphire Rapids