Interface HuggingFaceInferenceEmbeddingsParams

Interface that extends EmbeddingsParams and defines additional parameters specific to the HuggingFaceInferenceEmbeddings class.

Hierarchy

Implemented by

Properties

apiKey?: string
endpointUrl?: string
maxConcurrency?: number

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

maxRetries?: number

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

model?: string
onFailedAttempt?: FailedAttemptHandler

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Generated using TypeDoc