Inference Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Ranking Zero Shot Classification Automatic Speech Recognition Summarization Feature Extraction

Price $ 0 - 50 / hour

Hardware Accelerator

ALL CPU GPU INF2 TPU

Inference Server

All Llama.cpp TEI TGI

License

Hub Models

Browse All Models

11 items

TGI qwen Text Generation

Clear All

deepseek-ai /

DeepSeek-R1-Distill-Qwen-32B

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia L4

$ 3.8

/ hour

Qwen /

Qwen2.5-14B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen /

Qwen2.5-14B-Instruct-1M

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen /

Qwen2.5-72B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia A100

$ 16

/ hour

Qwen /

Qwen2.5-7B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

Qwen /

Qwen2.5-Coder-14B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen /

Qwen2.5-Coder-32B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 2x Nvidia A100

$ 8

/ hour

Qwen /

Qwen2.5-Coder-7B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

Qwen /

Qwen2.5-Math-72B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia A100

$ 16

/ hour

Qwen /

Qwen2.5-Math-7B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

GPU 1x Nvidia L40S

$ 1.8

/ hour

Qwen /

QwQ-32B

Text Generation

TGI

Accelerated Text Generation Inference

GPU 4x Nvidia L4

$ 3.8

/ hour