How do I test a Cloud scrape before running the full job?

Use Test scrape to validate a sitemap and its Cloud settings before starting a full scraping job.

Run a Test scrape

  1. Open the sitemap in Web Scraper Cloud.
  2. Open the Scrape tab.
  3. Configure the driver, proxy, request interval, page load delay, and other settings you want to test.
  4. Select Test scrape.
  5. Review the returned records and page outcomes before starting the full job.

Does Test scrape use URL credits?

No. A Test scrape does not consume URL credits.

It processes up to 500 links. The limit is based on links processed, not on the number of records returned. A processed link counts toward the limit even if it produces no data.

What should I check?

Use the test result to confirm:

  • The expected fields and records are returned.
  • The selected driver works with the website.
  • The proxy configuration provides access to the target pages.
  • The request interval and page load delay are appropriate.
  • Pagination, scrolling, clicks, and other navigation behave as expected.

Once the test result is correct, return to the Scrape tab and select Scrape to start the full job.

See the Run a Cloud scraping job documentation for more information.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us