Struct FastEmbedService 

pub struct FastEmbedService { /* private fields */ }

Wrapper around a [TextEmbedding] instance that implements EmbeddingModel.

Each inference call spawns a short-lived worker thread with a larger stack to satisfy ONNX Runtime’s stack requirements.

Implementations

impl FastEmbedService

pub fn new(model_name: &str, cache_dir: &Path) -> Result<Self>

Trait Implementations

impl EmbeddingModel for FastEmbedService

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, texts: Vec<&'life1 str>, ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Embed a batch of text strings into dense vectors.

fn dimensions(&self) -> u32

The dimensionality of the embedding vectors produced by this model.

fn model_id(&self) -> &str

The underlying model identifier (e.g. a HuggingFace repo ID or API model name).

fn warmup<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Optional warmup hook (e.g. load weights into memory on first access). The default is a no-op.