Why does the crawler display no data even after crawling a few pages?
The crawler works by sending requests simultaneously to get the data.
The data needs to be processed and is not displayed instantly, it takes some time to display the data, so please be patient and check back periodically.
This is especially the case when the crawler is provided hundreds of inputs or pages to crawl. Such cases WILL take time to crawl, process and display
Related Articles
Why does the crawler crawl more pages than the total number of records it collected?
Some crawlers can collect multiple records from a single page, while others might need to go to 3 pages to get a single record. For example our Amazon Bestsellers crawler collects 50 records from one page, while our Indeed crawler needs to go through ...
The API or Crawler is not returning the data I need
Our APIs or Crawlers only automate the process of extracting the data that's already on the website and is extractable. If the information isn't on the website or is in a format that is not extractable, we will not be able to get it for you at all. ...
Why does the Google crawler not return ALL results?
Google will always display only a few hundred results per query. So if your query has thousands of results, all those results will not be displayed by Google and as a result, we cannot gather that data for your either. Our crawler is dependent on ...
Why doesn't the Google crawler show me relevant results?
Our Google crawler gathers data returned by Google for a particular search term. If the search term has a lot of ads and other sponsored content associated with it, then they show up in the search results along with the search query and end up in the ...
How many page credits do I need to scrape data about businesses from Google Maps?
Our Google maps crawler needs to go through a list of all businesses and then go into each business' detail page to get additional data about each business such as their telephone, address, open hours, website address, etc. Here is the business ...