How do I start jobs and retrieve results through the API?

Use the Web Scraper Cloud API when another application needs to start scraping jobs and retrieve the completed data automatically.

API workflow

1. Configure a webhook endpoint.
2. Start the scraping job through the Cloud API.
3. Web Scraper Cloud sends the webhook when the job reaches a final status.
4. Return HTTP 2xx.
5. Use the scrapingjob_id   from the webhook to download the results through the API.
6. Process or import the data.

Use a webhook instead of repeatedly checking job status

For automated workflows, a webhook is usually the better way to detect when a job has finished. Web Scraper Cloud can notify your endpoint when the job reaches a final status, and the webhook includes the scrapingjob_id   needed for follow-up API requests.

The webhook does not contain the scraped dataset itself. Use the scrapingjob_id   with the Cloud API to retrieve the data.

See the Web Scraper Cloud API documentation and Webhook documentation for endpoint details and implementation examples.