Register Members List Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
  #1  
Old 20 Sep 2013, 15:26
pityocamptes's Avatar
pityocamptes pityocamptes is offline
 
Join Date: May 2010
Updated robot.txt file?

Does VB4 or this site provide an up-to-date robot.txt file? Any help appreciated. I have no mods at the moment, basically a vanilla copy with custom template. However, when I do install mods should those be added to the robot.txt file, and if so, which file generally is added? Thanks again.

On a side note, I have read some posts where people are changing the name fo their admincp file, which I have done and password protected. I have also seen where others are password protecting the modcp (?) file as well? I was wondering the reason why, and should the name be changed as well, or just PW protected? Any other files? Thanks.
Reply With Quote
  #2  
Old 21 Sep 2013, 06:45
crazyboy1661's Avatar
crazyboy1661 crazyboy1661 is offline
 
Join Date: Jan 2011
me too looking for dat.
Reply With Quote
  #3  
Old 22 Sep 2013, 08:05
blake247 blake247 is offline
 
Join Date: Sep 2008
# Robots.txt File for the domain http://www.myfreemasonry.com
# All robots will spider the domain

User-agent: myfreemasonry-Google
Disallow:

User-agent: *
Disallow: /go/
Disallow: /cgi-bin/
Disallow: /images/
Disallow: /admincp/
Disallow: /modcp/
Disallow: /attachment.php
Disallow: /search.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /editpost.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /login.php
Disallow: /subscription.php
Disallow: /private.php
Disallow: /report.php
Disallow: /sendmessage.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /postings.php
Disallow: /sendtofriend.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /showgroups.php
Disallow: /announcement.php

Sitemap: http://www.myfreemasonry.com/vbullet...p_index.xml.gz


what I use
__________________
Masons of Texas
http://www.masonsoftexas.com
Reply With Quote
  #4  
Old 22 Sep 2013, 08:45
pityocamptes's Avatar
pityocamptes pityocamptes is offline
 
Join Date: May 2010
Thanks! I assume this list does not include mods? If I have mods do I include those as well? Thanks for the feedback!
Reply With Quote
  #5  
Old 22 Sep 2013, 10:45
DF031 DF031 is offline
 
Join Date: Nov 2012
Thanks, that list is real helpfull !

BTW: One should not list the name of the admin en moderator panel in case they are renamed (as recommended by VB)
Reply With Quote
  #6  
Old 22 Sep 2013, 17:27
pityocamptes's Avatar
pityocamptes pityocamptes is offline
 
Join Date: May 2010
Originally Posted by DF031 View Post
Thanks, that list is real helpfull !

BTW: One should not list the name of the admin en moderator panel in case they are renamed (as recommended by VB)
How about the modcp? Is that ok to name?
Reply With Quote
  #7  
Old 22 Sep 2013, 22:23
ForceHSS's Avatar
ForceHSS ForceHSS is offline
 
Join Date: Apr 2008
Originally Posted by pityocamptes View Post
How about the modcp? Is that ok to name?
Best to remove the admin and modcp from that list above. Not a good idea to have that there
Reply With Quote
  #8  
Old 23 Sep 2013, 02:21
pityocamptes's Avatar
pityocamptes pityocamptes is offline
 
Join Date: May 2010
Originally Posted by ForceHSS View Post
Best to remove the admin and modcp from that list above. Not a good idea to have that there
ok, can modcp be renamed, and where do you need to make changes? Or is it not necessary?
Reply With Quote
  #9  
Old 23 Sep 2013, 02:44
ozzy47's Avatar
ozzy47 ozzy47 is offline
 
Join Date: Jul 2009
Real name: Chris
Rename Vbulletin admincp and modcp Directories for Better Security.

1) Rename the Admincp and Modcp folders to your chosen name

2) Rename the folder in your ftp client

3) Change vBulletin’s config.php file to match the new folders.

Important: after renaming the admincp and modcp folders, YOU MUST change their names in the config.php file to match the new names. Also when upgrading, make sure to rename the directories.

// ****** PATH TO ADMIN & MODERATOR CONTROL PANELS ******
// This setting allows you to change the name of the folders that the admin and
// moderator control panels reside in. You may wish to do this for security purposes.
// Please note that if you change the name of the directory here, you will still need
// to manually change the name of the directory on the server.

$config['Misc']['admincpdir'] = 'admincp';

$config['Misc']['modcpdir'] = 'modcp';
Reply With Quote
  #10  
Old 23 Sep 2013, 17:28
crazyboy1661's Avatar
crazyboy1661 crazyboy1661 is offline
 
Join Date: Jan 2011
Originally Posted by pityocamptes View Post
ok, can modcp be renamed, and where do you need to make changes? Or is it not necessary?
for security reasons it is must to change/rename the admin and modcp names as explained by ozzy47
Reply With Quote
  #11  
Old 06 Oct 2013, 15:11
DemOnstar's Avatar
DemOnstar DemOnstar is offline
 
Join Date: Dec 2012
Ok, from the example above, I am currently using this.


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

Does that seem in order?

I have removed some stuff..and added other things..

Thanks...
Reply With Quote
  #12  
Old 10 Nov 2013, 18:14
gsmlover4u's Avatar
gsmlover4u gsmlover4u is offline
 
Join Date: Jan 2007
what is benifit to disallow every thing
i think then search engine will not crawl website ?
Reply With Quote
  #13  
Old 10 Nov 2013, 18:23
Max Taxable's Avatar
Max Taxable Max Taxable is offline
 
Join Date: Feb 2011
There is no reason to have modcp or admincp in robots.txt - first of all this file is public, so you are telling the script kiddies out there where these pages are, no matter what you have named them.

Second and most important, bad bots ignore robots.txt anyway. Yes that's right - robots.txt isn't a law, or a automated restriction, it's a "please don't index this" page with no teeth at all.

Robots.txt is alot like gun laws - only the law abiding obey them or even pay any attention to them.

If google and other good bots index these pages, they generally won't show in search results because they have no content relevance.

If you want the bad bots out of your life installing THIS GREAT MOD is the way to go.
Reply With Quote
  #14  
Old 07 Mar 2016, 11:27
webmastersun's Avatar
webmastersun webmastersun is offline
 
Join Date: Oct 2013
Originally Posted by pityocamptes View Post
Does VB4 or this site provide an up-to-date robot.txt file? Any help appreciated.
You should do robots.txt depend on your forum, which sections/parts you want to block or allow robots then add
Disallow or Allow in your robots.txt file

Since vBulletin community is a forum to discuss all things about vBulletin, not SEO then I would suggest some SEO experts on this SEO forum
http://www.webmastersun.com/forums/1...e-Optimization

They can support solve more SEO problems and give you best solutions for your SEO questions.
Originally Posted by blake247 View Post
Disallow: /images/
Disallow: /register.php
I am wondering why you want to block this folder and file? it's still useful for search engine crawl and index your images file and register page.

Hope it helps!

Last edited by webmastersun; 07 Mar 2016 at 11:34.
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 04:39.

Layout Options | Width: Wide Color: