Inference Endpoints
  • Catalog
Inference Task
All Available TasksText GenerationText-to-ImageImage-Text-to-TextSentence EmbeddingsSentence SimilarityText RankingAutomatic Speech RecognitionFeature Extraction
Price $ 0 - 50 / hour
  • 0
  • 0.1
  • 0.5
  • 1
  • 5
  • 50
Inference Engine
AllLlama.cppTEIvLLMSGLang
Hardware Accelerator
ALLCPUGPUINF2
License
Hub Models
Browse All Models

Model Catalog

5 items
Applied Filters
LLAMACPP Text Generation Clear All
Author avatar
unsloth /

DeepSeek-R1-GGUF

42
Deployed 42 times
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ2_XXS
GPU 8x Nvidia A100
$ 20
Author avatar
bartowski /

QwQ-32B-Preview-GGUF

4
Deployed 4 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia L40S
$ 1.8
Author avatar
bartowski /

Qwen2.5-Coder-32B-Instruct-GGUF

56
Deployed 56 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Author avatar
lmstudio-community /

Llama-3.3-70B-Instruct-GGUF

56
Deployed 56 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 4x Nvidia L4
$ 3.8
Author avatar
unsloth /

DeepSeek-R1-GGUF

54
Deployed 54 times
Text Generation
Llama.cpp
Accelerated llama.cpp
IQ1_S
GPU 4x Nvidia L40S
$ 8.3