Skip to content
1 min read · 101 words

Variable: defaultMediaToTransformersInput

ts
const defaultMediaToTransformersInput: (
  media: Media,
  opts?: {
    audioSampleRate?: number;
  },
) => Promise<{
  data: unknown;
  kind: "audio" | "image";
}> = mediaToTransformersInput;

Defined in: src/batteries/llm/transformers_js/helpers.ts:577

Default mediaToTransformersInput.

Decode an ADK @nhtio/adk!Media into a transformers.js multimodal input.

Parameters

ParameterType
mediaMedia
opts?{ audioSampleRate?: number; }
opts.audioSampleRate?number

Returns

Promise<{ data: unknown; kind: "audio" | "image"; }>

Remarks

Image → RawImage.fromBlob(...); audio → Float32Array PCM at the model's sample rate (16 kHz default) via read_audio over a data: URL. Imports @huggingface/transformers lazily, so it's only loaded on the multimodal path. (Verified against a real Gemma-4 run — see plan 0a.)