Modelplane Modelplane docs

InferenceGateway Custom Resource

This document is for an unreleased version of Modelplane.

This document applies to the Modelplane main branch and not to the latest release v0.3.

Unified OpenAI-compatible endpoint on the control plane cluster.

Concept guide: Set Up the Gateway →

#Metadata

API version
modelplane.ai/v1alpha1
Kind
InferenceGateway
Scope
Cluster
Short names
ig

#Example

Manifest
apiVersion: modelplane.ai/v1alpha1
kind: InferenceGateway
metadata:
  name: default
spec:
  backend: Traefik
  traefik:
    version: "40.2.0"
    loadBalancer: MetalLB
    metallb:
      addressPool: "172.18.255.200-172.18.255.250"

#Spec

# backend required enum: Traefik

Gateway implementation.

# traefik optional object

Traefik Proxy configuration. Required when backend is Traefik.

# loadBalancer optional enum: MetalLB

Load balancer implementation for the gateway Service. Omit for cloud environments where a native LB controller is available.

# metallb optional object

MetalLB configuration. Required when loadBalancer is MetalLB. Use for kind or bare-metal clusters.

# addressPool required string

IP address range for the MetalLB pool (e.g. “172.18.255.200-172.18.255.250”). Must be within the cluster’s network CIDR.

# version required string

Traefik Helm chart version.

#Status

# address optional string

External address of the control plane gateway. Backend-agnostic — works for any routing implementation.