Skip to main content

Module local_onnx

Module local_onnx 

Source
Expand description

Local ONNX Runtime provider (local/onnx).

Single backend, multiple tasks. The provider declares ModelTask::Raw and ModelTask::Rerank in ProviderCapabilities and dispatches inside ModelProvider::load — matching the pattern used by cohere.rs, mistralrs.rs, etc.

Task implementations live in private submodules:

Structs§

LocalOnnxProvider