advance-scraper · dashboard

Start a crawl

Mode Engine

Start URL (crawl)

URLs (list, comma)

Max depth Max pages

Webhook URL (opt)

Webhook secret (opt)

Advanced options (proxies, anti-captcha, timing, extraction)

Identity

Proxies (one per line)

Webshare API key

Cloudflare bypass Anti-captcha

Crawl bounds

Concurrency

Max links/page

Requests/min

Same-domain delay (s)

Max retries

Max HTML bytes

Strategy skip ?query & /page/N respect robots.txt

Browser / timing

Wait until block images/css/media

Wait after load (ms)

Wait for selector

Req timeout (s)

Nav timeout (s)

Selector timeout (ms)

Extraction

SEO bundle include rawHtml

extract overrides (JSON)

Current process auto-refresh

No job on this instance yet.

Live stream (WebSocket)

records: 0

Latest records

seq	status	url	title

Job history (from Postgres)

started	status	engine	start url	crawled	errors	found	dur

Events

Select a job's “Events” above to view its log.

Create API key (requires an admin / env key above)

Name / label

Env API_KEYS are admin keys (full access + key management). Keys created here are regular keys (full crawl API, can't manage keys) and work immediately.

Existing keys

prefix	name	created	last used	status