Skip to content
1 min read · 80 words

Interface: GpuBufferInstrument

Defined in: src/batteries/llm/chat_common/gpu_budget.ts:162

A handle returned by instrumentGpuBuffers: read live samples, then uninstall() to restore.

Properties

PropertyTypeDescriptionDefined in
sample() => GpuBufferSampleTake a live sample of GPU buffer usage.src/batteries/llm/chat_common/gpu_budget.ts:164
uninstall() => voidRestore the original createBuffer/destroy (idempotent). Call when done measuring.src/batteries/llm/chat_common/gpu_budget.ts:166