Skip to content
1 min read · 264 words

Interface: ScrapperCommonParams

Defined in: batteries/tools/scrapper/index.ts:48

Model-facing params common to both verbs (snake_case; mapped to kebab on the wire).

Extended by

Properties

PropertyTypeDescriptionDefined in
cache?booleanReturn a cached result when available instead of re-scraping.batteries/tools/scrapper/index.ts:50
device?stringEmulated device, e.g. Desktop Chrome. Overrides individual viewport/UA settings.batteries/tools/scrapper/index.ts:64
extra_http_headers?stringExtra headers the SCRAPER's browser sends to the TARGET site, K:v;K2:v2 (NOT instance auth).batteries/tools/scrapper/index.ts:68
incognito?booleanRun in an incognito browser context (no persisted browsing data). Default true upstream.batteries/tools/scrapper/index.ts:54
proxy_server?stringUpstream proxy, e.g. http://host:3128 or socks5://host:1080.batteries/tools/scrapper/index.ts:70
screenshot?booleanCapture a screenshot; the result carries a screenshotUri.batteries/tools/scrapper/index.ts:52
scroll_down?numberScroll down N pixels for lazy-loading pages. Requires a positive sleep.batteries/tools/scrapper/index.ts:62
sleep?numberWait this many ms after load before parsing.batteries/tools/scrapper/index.ts:60
timeout?numberBrowser navigation timeout in ms (0 disables). Distinct from the tool's own fetch timeout.batteries/tools/scrapper/index.ts:56
user_agent?stringExplicit user-agent (prefer device).batteries/tools/scrapper/index.ts:66
wait_until?"load" | "domcontentloaded" | "networkidle" | "commit"When navigation is considered finished.batteries/tools/scrapper/index.ts:58