More flexible Google Robots Exclusion Protocol
Aug 1st, 2007Just wanted to give quick news update.
There are two new features added to the protocol and will help webmasters control when an item should stop showing up in Google’s web search, as well as providing some more control over the indexing of other data types.
One of the features, support for the unavailable_after tag, has
been mentioned [...]






