Skip to main content

Module reliability

Module reliability 

Source
Expand description

Reliability primitives: circuit breaker, instrumented model wrappers with timeout and retry support, and metrics emission.

Structsยง

CircuitBreakerConfig
Tunable parameters for the circuit breaker.
CircuitBreakerWrapper
Thread-safe circuit breaker that tracks failures and short-circuits calls when a provider is unhealthy.
InstrumentedAudioEmbeddingModel
Wrapper around an AudioEmbeddingModel adding timeout / retry / metrics.
InstrumentedDocumentExtractionModel
Wrapper around a DocumentExtractionModel adding timeout / retry / metrics.
InstrumentedEmbeddingModel
Wrapper around an EmbeddingModel that adds per-call timeout enforcement, exponential-backoff retries for transient errors, and metrics emission (model_inference.duration_seconds, model_inference.total).
InstrumentedGeneratorModel
Wrapper around a GeneratorModel that adds timeout, retry, and metrics.
InstrumentedHybridEmbeddingModel
Wrapper around a HybridEmbeddingModel adding timeout / retry / metrics.
InstrumentedImageEmbeddingModel
Wrapper around an ImageEmbeddingModel adding timeout / retry / metrics.
InstrumentedMultiVectorEmbeddingModel
Wrapper around a MultiVectorEmbeddingModel adding timeout / retry / metrics.
InstrumentedMultimodalEmbeddingModel
Wrapper around a MultimodalEmbeddingModel adding timeout / retry / metrics.
InstrumentedNlpModel
Wrapper around an NlpModel adding timeout / retry / metrics.
InstrumentedOcrModel
Wrapper around an OcrModel adding timeout / retry / metrics.
InstrumentedRawTensorModel
Wrapper around an RawTensorModel that adds timeout, retry, and metrics.
InstrumentedRerankerModel
Wrapper around a RerankerModel that adds timeout, retry, and metrics.
InstrumentedSparseEmbeddingModel
Wrapper around a SparseEmbeddingModel adding timeout / retry / metrics.
InstrumentedTranscriptionModel
Wrapper around a TranscriptionModel adding timeout / retry / metrics to the batch transcribe call.