Web Queries
Crawl Status
Poll the progress and results of a crawl job
GET
Poll a crawl started via Start Crawl. While running, the response reports progress (
completed / total); once finished, it includes the scraped data for every page.
Path Parameters
The
crawl_id returned when the crawl was started.Response
crawling, completed, or failed.Pages scraped so far.
Total pages discovered.
Present once completed: one scrape result per page (same shape as Scrape URL
data).