Models & Groups

The catalog defines which real model on which node a display model name maps to (model mapping). A model can live on multiple nodes; the gateway picks one by health/load.

#Model groups

A model group collects multiple members under one virtual model name. A client uses the group name as the model; the group selects among members by its strategy. Members carry capability tags (vision, code), preferred nodes, weight, priority and cost.

Strategies: priority, weighted, round_robin, content, auto and flow. flow is the superset router graph — see the Flow Routing section.