Skip to content
9 min read · 1,733 words

Interface: DispatchContext

Context object for a single LLM execution call.

Remarks

Mirrors the surface of @nhtio/adk!TurnContext but is path-agnostic — it knows nothing about a parent context. Mutations apply to local Sets immediately, call persistence callbacks immediately, and fire the corresponding mutation hook (storedMemory, mutatedMemory, deletedMemory, etc.) in both standalone and derived dispatches.

The @nhtio/adk!DispatchRunner is the only thing that creates a context with a parent relationship: when dispatched with a source: TurnContext, the runner subscribes to the mutation hooks, queues deltas internally, and flushes them to the parent's Sets at the end of each iteration. The context itself remains unaware of the parent.

Middleware/executor signals termination via DispatchContext.ack (clean completion) or DispatchContext.nack (failure). Both set an internal flag the runner reads at end-of-iteration to decide whether to loop or exit. DispatchContext.isSignalled, DispatchContext.isAcked, and DispatchContext.nackError are publicly readable getters so middleware can inspect signal state and bail early.

Properties

PropertyModifierTypeDescription
abortreadonly(reason?: unknown) => voidAborts the dispatch's AbortController with the supplied reason. Middleware should call this when refusing to proceed — the runner short-circuits cleanly, dispatchEnd.status resolves to 'aborted', and no error event is emitted.
abortedreadonlybooleantrue when the abort controller signal has fired.
abortSignalreadonlyAbortSignalThe AbortSignal from the execution's AbortController.
deleteMemoryreadonly(id: string) => Promise<void>Removes a memory from the local Set and persistence layer by ID.
deleteMessagereadonly(id: string) => Promise<void>Removes a message from the local Set and persistence layer by ID.
deleteRetrievablereadonly(id: string) => Promise<void>Removes a retrievable record from the local Set and persistence layer by ID.
deleteStandingInstructionreadonly(v: string | Tokenizable) => Promise<void>Removes a standing instruction from the local Set and persistence layer.
deleteThoughtreadonly(id: string) => Promise<void>Removes a thought from the local Set and persistence layer by ID.
deleteToolCallreadonly(id: string) => Promise<void>Removes a tool call from the local Set and persistence layer by ID.
dispatchIdreadonlystringStable identifier for the dispatch this context belongs to; set by DispatchRunner.
emitMessagereadonlyEmitMessageFnEmits a message hook; fires registered handlers synchronously.
emitThoughtreadonlyEmitThoughtFnEmits a thought hook; fires registered handlers synchronously.
emitToolCallreadonlyEmitToolCallFnEmits a toolCall hook; fires registered handlers synchronously.
emitToolExecutionEndreadonlyEmitToolExecutionEndFnEmits a toolExecutionEnd hook; fires registered handlers synchronously.
emitToolExecutionStartreadonlyEmitToolExecutionStartFnEmits a toolExecutionStart hook; fires registered handlers synchronously.
fetchMemoriesreadonly() => | Memory[] | Promise<Memory[]>Fetches memories; delegates to the callback supplied at construction.
fetchMessagesreadonly() => | Message[] | Promise<Message[]>Fetches messages; delegates to the callback supplied at construction.
fetchRetrievablesreadonly() => | Retrievable[] | Promise<Retrievable[]>Fetches retrievable records; delegates to the callback supplied at construction.
fetchThoughtsreadonly() => | Thought[] | Promise<Thought[]>Fetches thoughts; delegates to the callback supplied at construction.
fetchToolCallsreadonly() => | ToolCall[] | Promise<ToolCall[]>Fetches tool calls; delegates to the callback supplied at construction.
fetchToolsreadonly() => | Tool<SpooledArtifact>[] | Promise<Tool<SpooledArtifact>[]>Fetches tools; delegates to the callback supplied at construction.
idreadonlystringUnique identifier for this execution context, generated as UUIDv6 at construction time.
isAckedreadonlybooleantrue when the context was signalled via DispatchContext.ack.
isSignalledreadonlybooleantrue once DispatchContext.ack or DispatchContext.nack has been called.
iterationreadonlynumber0-based iteration count within the current dispatch; updated by DispatchRunner.
mutateMemoryreadonly(v: Memory) => Promise<void>Updates an existing memory in the local Set and persistence layer.
mutateMessagereadonly(v: Message) => Promise<void>Updates an existing message in the local Set and persistence layer.
mutateRetrievablereadonly(v: Retrievable) => Promise<void>Updates an existing retrievable record in the local Set and persistence layer.
mutateStandingInstructionreadonly(v: string | Tokenizable) => Promise<void>Updates an existing standing instruction in the local Set and persistence layer.
mutateThoughtreadonly(v: Thought) => Promise<void>Updates an existing thought in the local Set and persistence layer.
mutateToolCallreadonly(v: ToolCall) => Promise<void>Updates an existing tool call in the local Set and persistence layer.
nackErrorreadonlyError | undefinedThe error stored by DispatchContext.nack, or undefined if not nacked.
refreshStandingInstructionsreadonly() => | (string | Tokenizable)[] | Promise<(string | Tokenizable)[]>Refreshes and returns standing instructions.
standingInstructionsreadonlySet<Tokenizable>Standing instructions for this execution, in insertion order.
stashreadonlyRegistryArbitrary key-value store for cross-step state.
storeMemoryreadonly(v: Memory) => Promise<void>Stores a new memory in the local Set and persistence layer.
storeMessagereadonly(v: Message) => Promise<void>Stores a new message in the local Set and persistence layer.
storeRetrievablereadonly(v: Retrievable) => Promise<void>Stores a new retrievable record in the local Set and persistence layer.
storeStandingInstructionreadonly(v: string | Tokenizable) => Promise<void>Stores a new standing instruction in the local Set and persistence layer.
storeThoughtreadonly(v: Thought) => Promise<void>Stores a new thought in the local Set and persistence layer.
storeToolCallreadonly(v: ToolCall) => Promise<void>Stores a new tool call in the local Set and persistence layer.
systemPromptreadonlyTokenizableThe system prompt for this execution.
toolsreadonlyToolRegistryTool registry for this execution.
turnMemoriesreadonlySet<Memory>Memories loaded for this execution.
turnMessagesreadonlySet<Message>Messages loaded for this execution.
turnRetrievablesreadonlySet<Retrievable>Retrievable records loaded for this execution.
turnThoughtsreadonlySet<Thought>Thoughts loaded for this execution.
turnToolCallsreadonlySet<ToolCall>Tool calls loaded for this execution.
waitForreadonlyOpenGateFnOpens a gate and suspends until it resolves, rejects, times out, or is aborted.

Methods

_getHooks()

ts
_getHooks(): Hooks<DispatchContextHooks>;

Internal

Accessor used by @nhtio/adk!DispatchRunner to register forwarding handlers.

Returns

Hooks<DispatchContextHooks>


_setDispatchId()

ts
_setDispatchId(id: string): void;

Internal

Set by @nhtio/adk!DispatchRunner after construction.

Parameters

ParameterType
idstring

Returns

void


_setIteration()

ts
_setIteration(n: number): void;

Internal

Updated by @nhtio/adk!DispatchRunner on each iteration.

Parameters

ParameterType
nnumber

Returns

void


ack()

ts
ack(): void;

Signals successful completion of this execution.

Returns

void

Remarks

Sets the context's internal signal flag. The @nhtio/adk!DispatchRunner reads the flag at the end of each iteration to decide whether to loop or exit. Calling ack() does NOT abort the current iteration — the current pipeline and flush complete first.

Throws

@nhtio/adk!E_LLM_EXECUTION_ALREADY_SIGNALLED when the context has already been signalled (whether via ack() or nack()).


nack()

ts
nack(error?: Error): void;

Signals failed completion of this execution, optionally with an error.

Parameters

ParameterTypeDescription
error?ErrorOptional error describing the failure. If omitted, a generic Error is used.

Returns

void

Remarks

Sets the context's internal signal flag and stores the error. The @nhtio/adk!DispatchRunner reads the flag at the end of each iteration and surfaces the error via the dispatchEnd observability payload and as the rejection reason of dispatch(). Calling nack() does NOT abort the current iteration — the current pipeline and flush complete first.

Throws

@nhtio/adk!E_LLM_EXECUTION_ALREADY_SIGNALLED when the context has already been signalled.


onAck()

ts
onAck(handler: () => void): () => void;

Registers a handler to run when this context completes successfully via ack.

Parameters

ParameterTypeDescription
handler() => voidCallback invoked when ack() is called.

Returns

An unsubscribe function that removes the handler.

() => void

Remarks

The handler does NOT fire on nack — failed executor runs should leave any ack-tied subscriptions alone so the consumer can inspect what was registered when debugging the failure. Returns an unsubscribe function; subscriptions are short-lived and die with the context regardless.

The canonical consumer is ToolRegistry.bindContext(ctx), which uses this hook to drop ephemeral tools (notably forged artifact-query tools from SpooledArtifact.forgeTools(ctx)) at ctx-completion. Consumers may also register custom handlers here for any per-executor cleanup.

See


toolCallCount()

ts
toolCallCount(checksum: string): number;

Returns how many times a tool call with the given checksum has been stored in this execution.

Parameters

ParameterTypeDescription
checksumstringThe ToolCall.checksum value to look up.

Returns

number

Remarks

Checksums are computed over tool + args (see @nhtio/adk!ToolCall.checksum). This count lets the executor detect repeat invocations of the same call without scanning the full Set. Returns 0 when the checksum has not been seen.