Function: mediaToTransformersInput()

function mediaToTransformersInput(
  media: Media,
  opts?: {
    audioSampleRate?: number;
  },
): Promise<{
  data: unknown;
  kind: "audio" | "image";
}>;

Defined in: src/batteries/llm/transformers_js/helpers.ts:456

Decode an ADK @nhtio/adk!Media into a transformers.js multimodal input.

Parameters

Parameter	Type
media	Media
opts?	{ audioSampleRate?: number; }
opts.audioSampleRate?	number

Returns

Promise<{ data: unknown; kind: "audio" | "image"; }>

Remarks

Image → RawImage.fromBlob(...); audio → Float32Array PCM at the model's sample rate (16 kHz default) via read_audio over a data: URL. Imports @huggingface/transformers lazily, so it's only loaded on the multimodal path. (Verified against a real Gemma-4 run — see plan 0a.)