Displaying posts tagged: search-engine

Weird behaviour from a Russian search engine

No Comments
I spend probably far too much time trawling my logs looking for odd behavior. Now I don't get much traffic here, but I'm a Yorkshireman so I'm stingy with my bandwidth, so I'll happily add search engines to my robots.txt or block them at the firewall if they get too greedy and trawl the site too ...