Web Queries
Crawl Status
Poll the progress and results of a crawl job
GET
Poll a crawl started via Start Crawl. While running, the response reports progress (
completed / total); once finished, it includes the scraped data for every page.
Path Parameters
string
required
The
crawl_id returned when the crawl was started.Response
string
crawling, completed, or failed.number
Pages scraped so far.
number
Total pages discovered.
array
Present once completed: one scrape result per page (same shape as Scrape
URL
data).