Endpoints

Inference Catalog

57 items
GPU Text Generation
Clear All
Author avatar
deepseek-ai /

DeepSeek-R1-Distill-Llama-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
deepseek-ai /

DeepSeek-R1-Distill-Qwen-32B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
unsloth /

DeepSeek-R1-GGUF

Text Generation
Quantization: IQ1_S
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
unsloth /

DeepSeek-R1-GGUF

Text Generation
Quantization: IQ2_XXS
GPU 8x Nvidia L40S
$ 23.5
/ hour
Author avatar
ibm-granite /

granite-3.1-8b-base

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-13b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-13b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-70b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-2-70b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-2-7b-chat-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-2-7b-hf

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
meta-llama /

Llama-3.1-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-3.1-70B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L40S
$ 8.3
/ hour
Author avatar
meta-llama /

Llama-3.1-8B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.1-8B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-1B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-1B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-3B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Llama-3.2-3B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
lmstudio-community /

Llama-3.3-70B-Instruct-GGUF

Text Generation
Quantization: Q8_0
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
meta-llama /

Meta-Llama-3-70B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
meta-llama /

Meta-Llama-3-70B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
meta-llama /

Meta-Llama-3-8B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
meta-llama /

Meta-Llama-3-8B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-Instruct-v0.3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-7B-v0.3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
mistralai /

Mistral-Nemo-Instruct-2407

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
mistralai /

Mistral-Small-24B-Instruct-2501

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
mistralai /

Mixtral-8x22B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 8x Nvidia L40S
$ 23.5
/ hour
Author avatar
mistralai /

Mixtral-8x7B-Instruct-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
mistralai /

Mixtral-8x7B-v0.1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Intel /

neural-chat-7b-v3-1

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Intel /

neural-chat-7b-v3-3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
openchat /

openchat-3.5-0106

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
microsoft /

Phi-3-mini-128k-instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
microsoft /

Phi-3-mini-4k-instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
microsoft /

phi-4

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-14B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Qwen /

Qwen2.5-14B-Instruct-1M

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Qwen /

Qwen2.5-72B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
Qwen /

Qwen2.5-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-14B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-32B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 2x Nvidia A100
$ 8
/ hour
Author avatar
bartowski /

Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation
Quantization: Q4_K_M
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
Qwen /

Qwen2.5-Coder-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

Qwen2.5-Math-72B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia A100
$ 16
/ hour
Author avatar
Qwen /

Qwen2.5-Math-7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
Qwen /

QwQ-32B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
bartowski /

QwQ-32B-Preview-GGUF

Text Generation
Quantization: Q8_0
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
RekaAI /

reka-flash-3

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
simplescaling /

s1.1-32B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
HuggingFaceTB /

SmolLM2-1.7B

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
HuggingFaceTB /

SmolLM2-1.7B-Instruct

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
berkeley-nest /

Starling-LM-7B-alpha

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour
Author avatar
qihoo360 /

TinyR1-32B-Preview

Text Generation
TGI
Accelerated Text Generation Inference
GPU 4x Nvidia L4
$ 3.8
/ hour
Author avatar
lmsys /

vicuna-7b-v1.5

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L40S
$ 1.8
/ hour
Author avatar
huggingFaceH4 /

zephyr-7b-beta

Text Generation
TGI
Accelerated Text Generation Inference
GPU 1x Nvidia L4
$ 0.8
/ hour