Modelplane Modelplane docs
Version
main v0.3 Latest v0.2 v0.1

ModelService Custom Resource

On this page
This document is for an older version of Modelplane.

This document applies to Modelplane v0.2 and not to the latest release v0.3.

Expose model endpoints via a unified OpenAI-compatible URL.

Concept guide: Expose a Model →

#Metadata

API version
modelplane.ai/v1alpha1
Kind
ModelService
Scope
Namespaced
Short names
ms

#Example

Manifest
apiVersion: modelplane.ai/v1alpha1
kind: ModelService
metadata:
  name: qwen-72b
  namespace: ml-team
spec:
  endpoints:
    - selector:
        matchLabels:
          modelplane.ai/deployment: qwen-72b

#Spec

# endpoints required object[] ≥ 1 items
# selector required object
# matchLabels required map[string]string
# weight optional integer 1–1000000 default: 1

Weight determines the share of traffic sent to this entry’s endpoints, relative to the other entries. An entry with weight 2 receives twice the traffic of an entry with weight 1. The weight is spread as evenly as possible across all endpoints the entry matches.

#Status

# address optional string

Public address where this service is reachable.

# conditions optional object[]