What are URL credits and how are they calculated?

URL credits measure how many pages Web Scraper Cloud processes. One processed page uses one URL credit, regardless of how many records or values are extracted from that page.

How URL credits are counted

• One listing page that returns 100 products uses 1 URL credit.
• Opening 100 individual product pages uses 100 URL credits.
• If a sitemap loads both listing pages and detail pages, credits are used for both.

The number of records in the final dataset does not determine the number of credits used. What matters is how many pages the scraper loads.

Example

If a scrape processes 20 category or listing pages and then opens 500 product-detail pages, it uses approximately 520 URL credits.

Do retries use additional credits?

No. Automatic retries of Empty and Failed pages do not consume additional URL credits.

Does a Test scrape use credits?

No. A Test scrape can process up to 500 links without consuming URL credits. The 500-link limit is based on links processed, including links that return no data.

Plan allowances

Project and Professional plans have monthly URL-credit allowances. The Scale plan has unlimited URL credits, with scraping throughput instead depending mainly on the number of concurrent scrapers and how long jobs take to run.

You can check your current plan and usage in Web Scraper Cloud.

See the URL credits, parallel tasks and limits documentation for more information.