Skip to main content
POST
Create a provider-managed deployment

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Headers

Idempotency-Key
string
required

Stable key used to adopt the original durable operation after retries or disconnects.

Maximum string length: 128

Body

application/json
cloud
string
required
gpu
string
required
model
string
required
name
string
required
billing_mode
enum<string>
default:provider_account
Available options:
provider_account,
customer_wallet
compute_connection_id
string

Verified tenant-owned compute connection. Required for provider-account deployments unless the selected provider reports workspace_owned.

compute_mode
enum<string>
Available options:
elastic,
serverless
endpoint_name
string

Stable application endpoint alias. Defaults to the deployment name.

Pattern: ^[a-z0-9](?:[a-z0-9._-]{0,62}[a-z0-9])?$
gpu_count
integer
default:1

Accelerators allocated to each runtime replica.

Required range: 1 <= x <= 1024
managed_runtime_seconds
integer
Required range: 900 <= x <= 86400Must be a multiple of 60
max_replicas
integer
Required range: x >= 0
min_replicas
integer
Required range: x >= 0
model_revision
string
model_secret_reference_id
string

Tenant-scoped server-side credential reference for private or gated model resolution.

port
integer
Required range: 1 <= x <= 65535
provider_adapter
string

Exact provider profile for this immutable revision; omit only when the cloud/runtime default is unambiguous.

region
string
runtime
enum<string>
default:vllm
Available options:
vllm,
sglang,
custom-oci
runtime_args
string[]
runtime_env
object

Reviewed engine environment switches for the runtime's pinned image on the GPU's platform, such as VLLM_ROCM_USE_AITER (0 or 1) for vLLM 0.22.1 on AMD Instinct MI300X, MI325X, MI350X, and MI355X. Any other name or value is rejected, and adapters that cannot pass it refuse the deployment before provisioning. Never put credentials here.

runtime_version
string
serving
object
workload
object

Response

Durable operation accepted

operation
object
required
created
boolean
deployment
object