Thread: Miscellaneous Hacks - Ban Spiders by User Agent
View Single Post
Old 12 Sep 2011, 17:24
Simon Lloyd's Avatar
Simon Lloyd Simon Lloyd is offline
Join Date: Aug 2008
Real name: Simon
as a side note you don't need the full useragent string anymore to ban them, you can now enter any part of the string:
bai will result in baidu being banned just as will any string containing "bai"
Entering Mozilla will result in every useragent string containing that to be banned.

So, entering the full bot name but not useragent string will do, enter Baidu for that spider, dont enter Ya as something to ban as Yahoo will be banned just as Yandex will.
Kind regards,
Simon Microsoft Office Help
My Mods: Find my modifications here
Please do not pm me for support unless i have invited you to!
Reply With Quote