How often do search engines revisit web sites with spiders and adjust key words?

Question

I've changed the text on my welcome page in order to increase the chance of someone locating it using common key words but the search engines haven't noticed the changes. Do they send out spiders on a regular basis?

Answer 1

The frequency and depth of crawl by the SE bots is a function of how important they consider the page (website) to be. For example a site that ranks in the top ten for very popular search terms might be visited at least every day but a site that ranks only for very uncompetitive terms might be visited only once a month. Normally the higher the PageRank value of the page the more frequent the visits.

Pandak is completely wrong about the Revisit META tag. There is such a tag but Search Engines take absolutely no notice of it whatsoever as anyone who has a website and looks in their server logs can tell you.

The closest you can get to controlling the behaviour of a search engine bot is with the Googlebot and Google SiteMaps https://www.google.com/webmasters/sitema...

Answer 2

Actually, there are two different answers, at least.

The webpage itself may tell the spiders when to revisit a page. Then the search engines have their own policies (always changing) regarding how often to visit.

You can't control the search engine frequency, but you can control your own website. You can specify how often the search engines should revisit your page (using the code below), then either (1) wait until the next search engine revisit, whenever that may be, and the engine will read the code and return at a frequency based on the revist meta tag, or (2) you may need to inform the search engines with a submission. Of course, you should also remember that search engines may or may not be interested in your website so may not bother with it at all. There is never a guarantee that they will ever visit, much less revisit, a site.

Here's the code:

Answer 3

about every month or so..

Answer 4

every second.