[Sforums]

When you say "User Agents", you mean users or what? Not sure I understand purpose of this mod?

[Simon Lloyd]

A user agent string is delivered by pretty much everyone and everything that visits your site, if you have your vbulltin options set so admin can resolve ip addresses then go to who's online then click the ip address that you see on the right for a guest, spider or forum member it will resolve to a user agent string something like the one i posted above. Remember, Google is your friend http://en.wikipedia.org/wiki/User_agent

[Jncocontrol]

From my understanding, Spiders are suppose to be our friends in the Forum community?

[Boofo]

Not when there 25 of the same spiders crawling the site day after day, non-stop. And from China, to boot.

[oddball118]

I was wondering about that Baidu Spider. What would I add to the list to get rid of them? I usually see 10 - 20 at a time.

[Boofo]

Baidu

[Simon Lloyd]

Thanks Boofo, if you added Baiduspider then it would ban everything that has exactly that in the UA but not everything that had Baidu, so using just Baidu will ban everything that has that as part of its string so Baiduspider would also be banned.

[AURFSCAN]

I like the txt output. I'll have to check this out .... tagged

my htaccess

Block Disabled:      (Update License Status)
Suspended or Unlicensed Members Cannot View Code.

[Wayne Luke]

Originally Posted by Boofo

Baidu

I banned them at the server level. Not catering to the Chinese or Asian market and never will cater to the Chinese or Asian market so don't need them to index my site.

[oddball118]

Works as advertised. Thanks!

[Simon Lloyd]

Originally Posted by Wayne Luke

I banned them at the server level. Not catering to the Chinese or Asian market and never will cater to the Chinese or Asian market so don't need them to index my site.

It's been a long time since i've seen your name on a post Wayne, nice to see you again

[Simon Lloyd]

Originally Posted by Boofo

How did you do it at the server level?

If you use cPanel you can use the IP deny manager and ban a whole block of IP's (as well as single ones)

[Boofo]

I thought he was talking of banning spiders themselves and not IPs.

[Simon Lloyd]

Originally Posted by Wayne Luke

I banned them at the server level. Not catering to the Chinese or Asian market and never will cater to the Chinese or Asian market so don't need them to index my site.

By the way Wayne, a long while ago i joined vbCodex, then it went offline for a long while and when it came back up (as it is now) there's no members, posts and i'm not registered anymore - what's happening or do you have another vb coding related site?