Skip to main content

​
SGLang

SGLang is InferCrane’s second registered inference engine. The runtime profile pins the official lmsysorg/sglang:v0.5.12 multi-platform manifest by digest and launches its OpenAI-compatible server through the same provider-neutral workload contract used by custom OCI images. The image tag and launch form follow the official SGLang release and Docker documentation. InferCrane resolved the manifest digest during implementation; the immutable value is visible through infercrane integrations --output json and the persisted revision.
The built-in profile declares the immutable image and argv, so normal users do not repeat them. It is simulated-qualified for readiness/model identity, buffered and streaming OpenAI transport, client cancellation, connection draining, the metrics endpoint and immutable launch intent. Real SGLang GPU behavior—including model compatibility, tool calling, structured output, performance and provider shutdown behavior—remains deferred until consolidated manual qualification. Autoscaling is rejected for SGLang because normalized SGLang scaling signals are not yet qualified.