Why does Data Preview work but scraping returns no records?

Data Preview can show that an individual selector works on the page you are viewing, while the full scraping job can still return no records if the sitemap cannot reach or execute that selector correctly.

Check the selector tree

  1. Start with the first selector below _root .
  2. Preview each selector down the branch.
  3. Stop at the first selector that does not match or return the expected result.
  4. Check that every selector has the correct parent.

If a field is extracted from a detail page, its selector must be placed below the Link selector that opens that page.

Preview the complete output

Data Preview can be used for an individual selector or for all selectors in the current view. Preview the combined output to confirm that the sitemap produces the expected record structure, not only that one field can be extracted.

Test the pages the scraper will actually visit

Check representative pages, including:

  • A second pagination page
  • A detail page with a different layout
  • Content that appears after scrolling or clicking

Also confirm that the start URL opens the intended page and is not showing a consent screen, login page, or bot challenge.

Run a small test scrape

After the previews look correct, run a small local scrape or a Cloud job with a limited set of start URLs and inspect the actual results.

See the No data was extracted documentation and Preview and validate a sitemap documentation for more information.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us