Skip to content
1 min read · 127 words

Function: withModelSource()

ts
function withModelSource<T>(
  env: TransformersEnvLike,
  hook: TransformersJsModelSource,
  load: () => Promise<T>,
): Promise<T>;

Defined in: src/batteries/llm/transformers_js/model_source.ts:158

Run load() with hook installed on env, then restore — serialized against every other withModelSource call so concurrent adapter loads never clobber the global env. The hook is only active for the duration of load(); after it resolves (or rejects) the prior env cache config is restored even on error.

Type Parameters

Type Parameter
T

Parameters

ParameterTypeDescription
envTransformersEnvLikeThe transformers.js env object.
hookTransformersJsModelSourceThe resolver to install for this load.
load() => Promise<T>The async load operation (e.g. pipeline(...) / from_pretrained(...)).

Returns

Promise<T>