Inference Catalog | Inference Endpoints by Hugging Face

Inference Endpoints

Catalog

Inference Catalog

Search

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Ranking Zero Shot Classification Automatic Speech Recognition Summarization Feature Extraction

Price $ 0 - 50 / hour

0
0.1
0.5
1
5
50

Hardware Accelerator

ALL CPU GPU INF2 TPU

Inference Server

All Llama.cpp TEI TGI

License

Hub Models

Browse All Models

14 items

DeepSeek-R1-Distill-Qwen-32B

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia L4

$ 3.8

/ hour

gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Sentence Embeddings

Quantization: Q4_K_M

CPU 8x Intel Sapphire Rapids

$ 0.268

/ hour

Qwen2.5-14B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen2.5-14B-Instruct-1M

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen2.5-72B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia A100

$ 16

/ hour

Qwen2.5-7B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

Qwen2.5-Coder-14B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen2.5-Coder-32B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation

Quantization: Q4_K_M

GPU 1x Nvidia L4

$ 0.8

/ hour

Qwen2.5-Coder-7B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

Qwen2.5-Math-72B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia A100

$ 16

/ hour

Qwen2.5-Math-7B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

Qwen2.5-VL-7B-Instruct

Image-Text-to-Text

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

QwQ-32B

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia L4

$ 3.8

/ hour