Why does the Google crawler not return ALL results?

• Related Articles

• Why doesn't the Google crawler show me relevant results?

  Our Google crawler gathers data returned by Google for a particular search term. If the search term has a lot of ads and other sponsored content associated with it, then they show up in the search results along with the search query and end up in the ...

• Do you cache results?

  No, we always provide the latest and most accurate data present on the website. However, you are free to cache the results in your systems to reduce API calls and costs.

• How do I get geo-based results like delivery charges to a specific place?

  Most sites will display delivery charges or product availability automatically based on the user location or zip code. Our regular APIs use locations from all US states, so the pricing or availability may vary. To get accurate results based on a ...

• Why does the crawler crawl more pages than the total number of records it collected?

  Some crawlers can collect multiple records from a single page, while others might need to go to 3 pages to get a single record. For example our Amazon Bestsellers crawler collects 50 records from one page, while our Indeed crawler needs to go through ...

• Why does the crawler display no data even after crawling a few pages?

  The crawler works by sending requests simultaneously to get the data. The data needs to be processed and is not displayed instantly, it takes some time to display the data, so please be patient and check back periodically. This is especially the case ...