Base URL
The Base URL for a specific crawler is formatted as:https://relay.crawlstack.dev/ext/{extension_uuid}/crawler/{crawler_id}
Endpoints
GET /data
Execute the crawler or get cached data.
number
Max age of cached run in seconds. Defaults to 0 (always run).
string
Override the start URL for this execution.
GET /items
Get extracted items for the crawler.
number
Pagination cursor (last item ID).
number
default:"20"
Number of items to return.
string
If set to
true, returns all versions of items. Otherwise returns only the latest version.GET /items/{itemKey}/versions
Get history of a specific item.
string
required
The unique key of the item.