Base de connaissances

Telling Google How Often to Crawl Your Site

Google uses algorithms for determining how often to crawl your site. The end goal is to crawl as many pages as possible from your site on each visit without overwhelming your server's bandwidth.

Too many requests on your site in a short period can cause your site to load slowly.

If you do not experience bandwidth-related load issues on your server, you should allow Google to determine the optimal crawl rate for your website.

Changing Google's Crawl Rate

Google allows you to adjust the crawl rate, but you cannot specify different crawl rates for your site's section, such as specific folders or subdirectories.

Changing Google's crawl rate only changes the speed of Googlebot's requests during the crawl process. It does not affect how often Google crawls your site or how deeply the URL structure is crawled.

To change Google's crawl rate on your website:

  1. Access the Crawl Rate Settings page.
  2. The next page will display two options — Let Google optimize for my site (recommended) and Limit Google's maximum crawl rate.

    Google Crawl Rate Options

  3. Depending on the needs of your website, select your preferred action.
  • 0 Utilisateurs l'ont trouvée utile
Cette réponse était-elle pertinente?

Articles connexes

What is a cache

A cache is a reserved storage location that keeps data temporarily to help websites, browsers, and apps load faster. This makes quick data retrieval easy, which in turn helps devices run...

How Do I Take Screenshots on Windows?

Sometimes, when contacting our Customer Support, you may be asked for a screenshot of whatever problems you may be facing. In Windows, there are several ways to take a screenshot: 1. Using the...

How To Create Database User

1. Log in to cPanel. 2. Go to Databases section, then click MySQL Databases. 3. Click the Jump to MySQL Users link at the top-right corner of the page. 4. Under Add New User, enter a username...

How To Create MySQL Database

1. Log in to cPanel. 2. Look for the Databases section, then click MySQL Databases. 3. In the New Database field, type your database name. 4. Click Create Database. 5. Click Go Back.

How To Modify the php.ini file

Sometimes, you may need to modify some default PHP settings, and below we've outlined those steps. 1. Log in to cPanel. 2. Go to the Software section and click on the MultiPHP INI Editor icon....