How do I limit the number of records or reviews?

If repeated records are loaded by scrolling, you can stop after a specific number by setting an Element limit on the scrolling Element selector.

Limit records on an infinite-scroll list

  1. Create or open the Element selector that matches the repeated records.
  2. Enable Scroll.
  3. Set the Element limit to the maximum number of records you want returned.
  4. Preview the result and run a small test scrape.

The scraper stops scrolling when it can no longer discover new matching elements or when the configured Element limit is reached.

Example: limit customer reviews

If a product detail page contains a repeated review list that loads as you scroll, place an Element selector around the reviews, enable scrolling, and set the Element limit to the number of reviews you need.

detail_link
└── reviews (Element, scrolling enabled, element limit set)
    ├── reviewer
    ├── rating
    └── review_text

When Element limit does not apply

Element limit controls the maximum number of elements returned while scrolling. It is not a general limit for every type of sitemap navigation.

If additional records are loaded through numbered pagination or a Load more button, configure that navigation with a Pagination selector instead.

See the Element selector documentation and Pagination, load more and infinite scrolling documentation for more information.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us