Why does Data Preview work but scraping returns no records?
Data Preview can show that an individual selector works on the page you are viewing, while the full scraping job can still return no records if the sitemap cannot reach or execute that selector correctly.
Check the selector tree
- Start with the first selector below
_root. - Preview each selector down the branch.
- Stop at the first selector that does not match or return the expected result.
- Check that every selector has the correct parent.
If a field is extracted from a detail page, its selector must be placed below the Link selector that opens that page.
Preview the complete output
Data Preview can be used for an individual selector or for all selectors in the current view. Preview the combined output to confirm that the sitemap produces the expected record structure, not only that one field can be extracted.
Test the pages the scraper will actually visit
Check representative pages, including:
- A second pagination page
- A detail page with a different layout
- Content that appears after scrolling or clicking
Also confirm that the start URL opens the intended page and is not showing a consent screen, login page, or bot challenge.
Run a small test scrape
After the previews look correct, run a small local scrape or a Cloud job with a limited set of start URLs and inspect the actual results.
See the No data was extracted documentation and Preview and validate a sitemap documentation for more information.