Interface: ConverseInferenceConfig
Defined in: src/batteries/llm/bedrock_converse/types.ts:173
Sampling and output controls.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
maxTokens? | number | Upper bound on generated tokens. | src/batteries/llm/bedrock_converse/types.ts:175 |
stopSequences? | string[] | Sequences that halt generation. | src/batteries/llm/bedrock_converse/types.ts:181 |
temperature? | number | Sampling temperature. | src/batteries/llm/bedrock_converse/types.ts:177 |
topP? | number | Nucleus-sampling threshold. | src/batteries/llm/bedrock_converse/types.ts:179 |