Skip to main content

Call an InferCrane model

InferCrane Model APIs expose qualified open weight models through the OpenAI chat completions contract. Your application keeps one client while InferCrane operates the serving configuration, capacity, and release path behind it.

Create an API key

Sign in to the InferCrane console, choose a model, and create a scoped API key.

Send your first request

Set the key in your shell. Keep it on the server and never commit it to source control.
The API is compatible with the official OpenAI clients. Change the base URL and model name; the rest of the request shape stays familiar.
Install the official Python client with python -m pip install openai. For TypeScript, install it with npm install openai.

Discover available models

Availability and prices can change as capacity and qualification evidence change. Read the live catalog instead of copying a stale model list into your application.
The first qualified product is qwen3.8-27b with: These are serving limits for the current InferCrane release, not the maximum capabilities stated by the base model publisher.

Stream tokens

Set stream: true and consume standard server sent events. The final chunk includes normal OpenAI compatible completion metadata.

Handle capacity safely

InferCrane returns 429 Too Many Requests before an overloaded request enters an unbounded queue. Retry with exponential backoff and jitter. Respect Retry-After when it is present, and reuse your application request ID when retrying an operation that must be idempotent.
Inference prompts and responses are not retained for model training. See the privacy policy for the current service and subprocessors boundary.