LoadedModelHandle

Type Alias LoadedModelHandle 

Source
pub type LoadedModelHandle = Arc<dyn Any + Send + Sync>;
Expand description

A type-erased, reference-counted handle to a loaded model instance.

Providers wrap their concrete model (e.g. Arc<dyn EmbeddingModel>) inside this Arc<dyn Any + Send + Sync> so the runtime can store them uniformly. The runtime later downcasts the handle back to the expected trait object.

Aliased Typeยง

pub struct LoadedModelHandle { /* private fields */ }