Why does the crawler display no data even after crawling a few pages?

Why does the crawler display no data even after crawling a few pages?


The crawler works by sending requests simultaneously to get the data.
The data needs to be processed and is not displayed instantly, it takes some time to display the data, so please be patient and check back periodically.

This is especially the case when the crawler is provided hundreds of inputs or pages to crawl. Such cases WILL take time to crawl, process and display 


    • Related Articles

    • Why does the crawler crawl more pages than the total number of records it collected?

      Some crawlers can collect multiple records from a single page, while others might need to go to 3 pages to get a single record. For example our Amazon Bestsellers crawler collects 50 records from one page, while our Indeed crawler needs to go through ...

    • The API or Crawler is not returning the data I need

      Our APIs or Crawlers only automate the process of extracting the data that's already on the website and is extractable. If the information isn't on the website or is in a format that is not extractable, we will not be able to get it for you at all. ...

    • Why does the Google crawler not return ALL results?

      Google will always display only a few hundred results per query. So if your query has thousands of results, all those results will not be displayed by Google and as a result, we cannot gather that data for your either. Our crawler is dependent on ...

    • Data Credits: A New Way to Measure Your Scraping Usage

      We're excited to introduce a new, more intuitive way to track and manage your data scraping needs: Data Credits! This change will make it easier for you to understand and control your usage of ScrapeHero Cloud. What's Changing? We're moving from our ...

    • Why doesn't the Google crawler show me relevant results?

      Our Google crawler gathers data returned by Google for a particular search term. If the search term has a lot of ads and other sponsored content associated with it, then they show up in the search results along with the search query and end up in the ...