Expand description
The core runtime that manages providers, catalogs, and loaded model instances.
Structsยง
- Model
Registry - Internal registry that caches loaded model instances and coordinates concurrent load requests to prevent duplicate work.
- Model
Runtime - The central runtime that owns registered providers and a catalog of model aliases.
- Model
Runtime Builder - Builder for constructing a
ModelRuntimewith registered providers, a model catalog, and a warmup policy.