Inference Endpoints
  • Catalog
Inference Task
All Available TasksText GenerationText-to-ImageImage-Text-to-TextSentence EmbeddingsSentence SimilarityText RankingAutomatic Speech RecognitionFeature Extraction
Price $ 0 - 50 / hour
  • 0
  • 0.1
  • 0.5
  • 1
  • 5
  • 50
Inference Engine
AllLlama.cppTEIvLLMSGLang
Hardware Accelerator
ALLCPUGPUINF2
License
Hub Models
Browse All Models

Model Catalog

4 items
Applied Filters
LLAMACPP Image-Text-to-Text Clear All
Author avatar
ggml-org /

InternVL3-14B-Instruct-GGUF

16
Deployed 16 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L4
$ 0.8
Author avatar
ggml-org /

Qwen2.5-VL-3B-Instruct-GGUF

45
Deployed 45 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Author avatar
ggml-org /

Qwen2.5-VL-7B-Instruct-GGUF

50
Deployed 50 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Author avatar
ggml-org /

SmolVLM2-2.2B-Instruct-GGUF

24
Deployed 24 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
F16
GPU 1x Nvidia T4
$ 0.5