Struct ModelRuntimeBuilder 

pub struct ModelRuntimeBuilder { /* private fields */ }

Builder for constructing a ModelRuntime with registered providers, a model catalog, and a warmup policy.

let runtime = ModelRuntime::builder()
    // .register_provider(...)
    // .catalog(...)
    .build()
    .await?;

Implementations

impl ModelRuntimeBuilder

pub fn register_provider<P: ModelProvider + 'static>(self, provider: P) -> Self

Register a provider. The provider’s provider_id is used as the lookup key; registering a second provider with the same ID replaces the first.

pub fn catalog(self, catalog: Vec<ModelAliasSpec>) -> Self

Set the model catalog from a pre-built vector of specs.

pub fn catalog_from_str(self, s: &str) -> Result<Self>

Load catalog from a JSON string (array of model alias specs).

pub fn catalog_from_file(self, path: impl AsRef<Path>) -> Result<Self>

Load catalog from a JSON file (array of model alias specs).

pub fn warmup_policy(self, policy: WarmupPolicy) -> Self

Set the global warmup policy applied to providers during build.

pub async fn build(self) -> Result<Arc<ModelRuntime>>

Validate the catalog, execute the warmup policy, and return the constructed ModelRuntime.

Returns an error if any spec references an unknown provider, contains invalid options, or if a required eager warmup fails.

Trait Implementations

impl Default for ModelRuntimeBuilder

fn default() -> ModelRuntimeBuilder

Returns the “default value” for a type.