Inference Catalog
100 items
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Ranking
TEI
Accelerated Text Embeddings Inference
Zero Shot Classification
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
Quantization: Q4_K_M
Feature Extraction
TEI
Accelerated Text Embeddings Inference
Sentence Ranking
Quantization: F16
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
Quantization: Q8_0
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Sentence Ranking
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Sentence Embeddings
TEI
Accelerated Text Embeddings Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
Quantization: Q4_K_M
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Image-Text-to-Text
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference
Text Generation
TGI
Accelerated Text Generation Inference