Back to Catalog
Create Endpoint
Nanbeige

This model is from our Model Catalog, and comes with pre-configured recipes. Deployment has been verified by Hugging Face.

/
$5.50 / h
per running replica

General purpose Recipe

Balances answer speed and capacity, so one endpoint copes with varied requests.

Best for: Mixed everyday traffic. Trade-off: A specialised recipe beats it on that specialty, on the same hardware..
Input throughput
2,459.98 tok / s
Output throughput
315.71 tok / s
Request throughput
1.29 req / s
Cost per 1M tokens
$0.55
Time to first token
1,090 ms
Inter-token latency
55.27 ms
Generation speed
22.34 tok / s
Response time
25,360 ms

Measured at 16 concurrent requests of about 2,048 input and 256 output tokens — the heaviest measured load that still met every target.

Nvidia RTX PRO 6000 Blackwell
2x GPUs · 192 GB 46x vCPUs · 512 GB
$5.5 / h
Catalog Recipe
Pre-selected hardware for the current recipe.
  • Only you can access your endpoint, using a Hugging Face Token generated from your personal account.
Number of replicas
More options
Daily Autoscaling Schedule
Autoscaling Strategy

This Catalog Recipe comes with a pre-configured vLLM engine.

Engine Container URL optional

Default Env values come from the Catalog Recipe and can't be edited during Endpoint creation.

Default Env
Secret Env
VPC Config