ModelRoute Custom Resource
A ModelRoute is one ModelService’s routing on one InferenceGateway: the AIGatewayRoute matching the service’s model name, plus, per endpoint, the Backend, credential and policy the gateway needs to reach it. The ModelService composes one per gateway that serves it, pinned to that gateway, and this renders onto the gateway’s cluster.
It is machine-generated. kubectl get modelroutes -l modelplane.ai/service=<name> is the per-gateway view of where a service is served and whether each gateway is carrying it.
#Metadata
#Spec
Lower is preferred. Entries at the same priority share traffic by weight; a higher number is only tried when nothing below it has a healthy endpoint.
Selects ModelEndpoints in this route’s namespace.
Share of traffic for this entry relative to the other entries at the same priority, spread as evenly as possible across the endpoints it matches.
Name of the InferenceGateway this route is pinned to. The function resolves the gateway’s cluster, its ProviderConfig and its address from here, and renders onto that cluster.
Name of the ModelService this route belongs to. With the ModelRoute’s own namespace it derives the composed object names and the model name a caller passes (
#Status
External address of the gateway this route is on.
Observed endpoint counts for this route, across all priorities.
The name that gateway answers on, if it has one.
The name a caller passes as the request’s model,