Interface: OllamaRuntimeOptions
Defined in: src/batteries/llm/ollama/types.ts:91
Native Ollama runtime/sampling parameters — sent NESTED under the request body's options key, NOT at the top level (this is the key structural divergence from the OpenAI wire, where these sit at the top level). All fields are optional; set only the ones you want to override. An index signature allows forward-compatible passthrough of llama.cpp parameters this type has not yet enumerated.
Indexable
ts
[key: string]: unknownForward-compatible passthrough for additional llama.cpp parameters.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
frequency_penalty? | number | Frequency penalty. | src/batteries/llm/ollama/types.ts:119 |
main_gpu? | number | Primary GPU index. | src/batteries/llm/ollama/types.ts:127 |
min_p? | number | Min-p sampling cutoff. | src/batteries/llm/ollama/types.ts:101 |
num_batch? | number | Prompt-processing batch size. | src/batteries/llm/ollama/types.ts:123 |
num_ctx? | number | Context window (KV-cache) size in tokens. Independent of the ADK contextWindow guard. | src/batteries/llm/ollama/types.ts:93 |
num_gpu? | number | Number of layers to offload to GPU(s). | src/batteries/llm/ollama/types.ts:125 |
num_keep? | number | Tokens to keep from the initial prompt when context is exceeded. | src/batteries/llm/ollama/types.ts:111 |
num_predict? | number | Max tokens to predict (-1 = infinite, -2 = fill context). | src/batteries/llm/ollama/types.ts:109 |
num_thread? | number | CPU thread count. | src/batteries/llm/ollama/types.ts:129 |
numa? | boolean | Enable NUMA support. | src/batteries/llm/ollama/types.ts:131 |
penalize_newline? | boolean | Penalize newline tokens. | src/batteries/llm/ollama/types.ts:121 |
presence_penalty? | number | Presence penalty. | src/batteries/llm/ollama/types.ts:117 |
repeat_last_n? | number | Look-back window for repeat penalty. | src/batteries/llm/ollama/types.ts:115 |
repeat_penalty? | number | Penalty applied to repeated tokens. | src/batteries/llm/ollama/types.ts:113 |
seed? | number | RNG seed for reproducible outputs. | src/batteries/llm/ollama/types.ts:105 |
stop? | string | string[] | Stop sequence(s). | src/batteries/llm/ollama/types.ts:107 |
temperature? | number | Sampling temperature. | src/batteries/llm/ollama/types.ts:95 |
top_k? | number | Top-k sampling cutoff. | src/batteries/llm/ollama/types.ts:99 |
top_p? | number | Nucleus sampling cutoff. | src/batteries/llm/ollama/types.ts:97 |
typical_p? | number | Typical-p sampling cutoff. | src/batteries/llm/ollama/types.ts:103 |
use_mmap? | boolean | Memory-map the model. | src/batteries/llm/ollama/types.ts:133 |