AI Inference Platform

LLM inference gateway — live requests and batch jobs, self-hosted or via Anthropic/OpenAI.

The platform is currently offline — explore the source on GitHub or view the API docs.

Single inference

Send one prompt to the model and see the response come back.

Output

Response will appear here.