List of all items

Structs

• api::ModelAliasSpec
• api::ModelRuntimeKey
• api::RetryConfig
• provider::anthropic::RemoteAnthropicProvider
• provider::azure_openai::RemoteAzureOpenAIProvider
• provider::candle::CandleEmbeddingModel
• provider::candle::LocalCandleProvider
• provider::cohere::RemoteCohereProvider
• provider::fastembed::FastEmbedService
• provider::fastembed::LocalFastEmbedProvider
• provider::gemini::GeminiEmbeddingModel
• provider::gemini::GeminiGeneratorModel
• provider::gemini::RemoteGeminiProvider
• provider::mistral::RemoteMistralProvider
• provider::openai::OpenAIEmbeddingModel
• provider::openai::RemoteOpenAIProvider
• provider::vertexai::RemoteVertexAIProvider
• provider::vertexai::VertexAiEmbeddingModel
• provider::vertexai::VertexAiGeneratorModel
• provider::voyageai::RemoteVoyageAIProvider
• reliability::CircuitBreakerConfig
• reliability::CircuitBreakerWrapper
• reliability::InstrumentedEmbeddingModel
• reliability::InstrumentedGeneratorModel
• reliability::InstrumentedRerankerModel
• runtime::ModelRegistry
• runtime::ModelRuntime
• runtime::ModelRuntimeBuilder
• traits::GenerationOptions
• traits::GenerationResult
• traits::ProviderCapabilities
• traits::ScoredDoc
• traits::TokenUsage

Enums

• api::ModelTask
• api::WarmupPolicy
• error::RuntimeError
• provider::candle::CandleTextModel
• traits::ProviderHealth

Traits

• traits::EmbeddingModel
• traits::GeneratorModel
• traits::ModelProvider
• traits::RerankerModel

Functions

• api::catalog_from_file
• api::catalog_from_str
• cache::resolve_cache_dir
• cache::resolve_provider_cache_root
• cache::sanitize_model_name

Type Aliases

• error::Result
• traits::LoadedModelHandle

Constants

• cache::CACHE_ROOT_ENV