Inference Catalog

Inference Task

All Available Tasks Text Generation Text-to-Image Image-Text-to-Text Sentence Embeddings Sentence Ranking Zero Shot Classification Automatic Speech Recognition Summarization Feature Extraction

Price $ 0 - 50 / hour

Hardware Accelerator

ALL CPU GPU INF2 TPU

Inference Server

All Llama.cpp TEI TGI

License

Hub Models

6 items

Llama-2-7b-chat-hf

Text Generation

TGI

Accelerated Text Generation Inference

TPU 4x Chips

$ 4.75

/ hour

meta-llama /

Llama-2-7b-hf

Text Generation

TGI

Accelerated Text Generation Inference

TPU 4x Chips

$ 4.75

/ hour

meta-llama /

Meta-Llama-3-8B

Text Generation

TGI

Accelerated Text Generation Inference

TPU 4x Chips

$ 4.75

/ hour

meta-llama /

Meta-Llama-3-8B-Instruct

Text Generation

TGI

Accelerated Text Generation Inference

TPU 4x Chips

$ 4.75

/ hour

mistralai /

Mixtral-8x7B-Instruct-v0.1

Text Generation

TGI

Accelerated Text Generation Inference

TPU 8x Chips

$ 9.5

/ hour

mistralai /

Mixtral-8x7B-v0.1

Text Generation

TGI

Accelerated Text Generation Inference

TPU 8x Chips

$ 9.5

/ hour