DeutschGoogle uses algorithms for determining how often to crawl your site. The end goal is to crawl as many pages as possible from your site on each visit without overwhelming your server's bandwidth.
Too many requests on your site in a short period can cause your site to load slowly.
If you do not experience bandwidth-related load issues on your server, you should allow Google to determine the optimal crawl rate for your website.
Changing Google's Crawl Rate
Google allows you to adjust the crawl rate, but you cannot specify different crawl rates for your site's section, such as specific folders or subdirectories.
Changing Google's crawl rate only changes the speed of Googlebot's requests during the crawl process. It does not affect how often Google crawls your site or how deeply the URL structure is crawled.
To change Google's crawl rate on your website:
- Access the Crawl Rate Settings page.
- The next page will display two options — Let Google optimize for my site (recommended) and Limit Google's maximum crawl rate.
- Depending on the needs of your website, select your preferred action.
- 0 Benutzer fanden dies hilfreich
