Inference Endpoints
  • Catalog
Inference Task
All Available TasksText GenerationText-to-ImageImage-Text-to-TextSentence EmbeddingsSentence SimilarityText RankingAutomatic Speech RecognitionFeature Extraction
Price $ 0 - 50 / hour
  • 0
  • 0.1
  • 0.5
  • 1
  • 5
  • 50
Inference Engine
AllLlama.cppTEIvLLMSGLang
Hardware Accelerator
ALLCPUGPUINF2
License
Hub Models
Browse All Models

Model Catalog

5 items
Applied Filters
NEURON Text Generation Clear All
Author avatar
meta-llama /

Llama-3.1-8B-Instruct

432
Deployed 432 times
Text Generation
TGI
Accelerated Text Generation Inference
INF2 2x Cores
$ 0.75
Author avatar
meta-llama /

Meta-Llama-3-8B-Instruct

87
Deployed 87 times
Text Generation
TGI
Accelerated Text Generation Inference
INF2 2x Cores
$ 0.75
Author avatar
meta-llama /

Llama-3.1-70B-Instruct

86
Deployed 86 times
Text Generation
TGI
Accelerated Text Generation Inference
INF2 24x Cores
$ 12
Author avatar
meta-llama /

Llama-3.2-3B-Instruct

118
Deployed 118 times
Text Generation
TGI
Accelerated Text Generation Inference
INF2 2x Cores
$ 0.75
Author avatar
meta-llama /

Llama-3.2-1B-Instruct

49
Deployed 49 times
Text Generation
TGI
Accelerated Text Generation Inference
INF2 2x Cores
$ 0.75