Inference Catalog | Inference Endpoints by Hugging Face

Inference Endpoints

Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Feature Extraction Sentence Similarity Text Ranking Automatic Speech Recognition

Price $ 0 - 50 / hour

0
0.1
0.5
1
5
50

Inference Engine

All Llama.cpp TEI vLLM SGLang

Hardware Accelerator

ALL CPU GPU INF2

License

Hub Models

Browse All Models

Model Catalog

5 items

Applied Filters

NEURON Text Generation Clear All

Llama-3.1-8B-Instruct

Deployed 544 times

Text Generation

Accelerated vLLM

Meta-Llama-3-8B-Instruct

Text Generation

Accelerated vLLM

Llama-3.1-70B-Instruct

Text Generation

Accelerated vLLM

Llama-3.2-3B-Instruct

Deployed 156 times

Text Generation

Accelerated vLLM

Llama-3.2-1B-Instruct

Text Generation

Accelerated vLLM