How do I scrape a listing page?
A listing page contains repeated items such as products, jobs, properties, or directory entries. Each item should normally become one output record.
Create a wrapper for each item
- Use the listing page as the start URL.
- Create an Element selector that matches every repeated item on the page.
- Add the fields you want to extract as child selectors beneath the Element selector.
For example:
_root
└── item
├── name
├── price
├── item_url
└── image_url
Choose the selector for each field
- Use a Text selector for visible text such as names or prices.
- Use an Image selector for image URLs.
- Use a Link selector for URLs.
- Use an Element attribute selector when the value is stored in an HTML attribute.
Check the wrapper before scraping
Preview the Element selector and confirm that it matches only the repeated records you want. Watch for advertisements, recommendation cards, or other repeated blocks that may be included accidentally.
Avoid position-dependent selectors such as :nth-child() when possible because page layout changes can cause them to match the wrong element.
If the listing has more pages
Add a Pagination selector for numbered pages, Next buttons, or Load more controls. For infinite-scroll listings, enable scrolling on the Element selector.
See the Scrape listing pages documentation for more information.