Register Members List Search Today's Posts Mark Forums Read

Mod Options
robots.txt Manager Details »
robots.txt Manager
Mod Version: 1.00, by MUG (Member) MUG is offline
Developer Last Online: Mar 2010 I like it Show Printable Version Email this Page

This modification is in the archives.
vB Version: 2.2.x Rating: (1 vote - 5.00 average) Installs: 15
Released: 08 Feb 2003 Last Update: Never Downloads: 25
Not Supported Is in Beta Stage  

This script allows you to easily create a dynamically generated robots.txt file, based on specified rules.

If you use this hack, please click 'Install'

Screenshots will be attached...

Download Now

Only licensed members can download files, Click Here for more information.

Show Your Support

  • To receive notifications regarding updates -> Click to Mark as Installed.
  • This modification may not be copied, reproduced or published elsewhere without author's permission.
Old 17 Feb 2003, 18:56
MUG MUG is offline
Join Date: Apr 2002
Originally posted by mheinemann
I had disallowed "turnitin" and would like to be able to still block them.
I thought that I already included TurnitinBot in the .sql file?
Originally posted by mheinemann
The only suggestion I can think of is being able to import your current robots.txt
Good idea... it shouldn't be too hard to implement.
Reply With Quote
Old 02 Mar 2003, 01:47
mheinemann's Avatar
mheinemann mheinemann is offline
Join Date: May 2002
Real name: Mike
And maybe being able to manually edit it as well.
Reply With Quote
Old 09 Mar 2003, 03:18
stryka stryka is offline
Join Date: Aug 2002
My current robots.txt file is not being overwritten when I click submit?

I made the changes to the .htaccess file... is there anything else i should look @ ??

Reply With Quote
Old 12 Apr 2003, 16:05
MUG MUG is offline
Join Date: Apr 2002
1.1 Beta released. It includes the following bug fixes / additions:[list=1][*]Stripping of comments from generated file (although it is in the robots.txt specification, some bots choke on them)[*]Repairs newlines in generated file (old version sometimes produced \r\r\n)[*]Cleaner interface for control panel[*]Several other things I can't remember [/list=1]
Attached Files
File Type: zip (7.2 KB, 34 views)

Last edited by MUG; 12 Apr 2003 at 16:10.
Reply With Quote
Old 29 May 2003, 14:36
Mickie D Mickie D is offline
Join Date: Jun 2002
thanks for this hack its very useful and i think it should be a full release

i have one problem and it has nothing to do with your script

where can i find info on what bots i should ban i never had turnit in bot banned b4 .. why is that bot bad ???
Digitalworldz Satellite Cable TV Forums
Cable, Satellite, Consoles, Mobile Phones, Audio Visual, and general chat
Reply With Quote
Old 29 May 2003, 18:34
PixelFx PixelFx is offline
Join Date: Dec 2002
very cool, now I don't need to do this manually all the time thank you for sharing
Reply With Quote
Old 30 Jul 2003, 23:00
stryka stryka is offline
Join Date: Aug 2002
I get an error after i updated to 1.1

Fatal error: db_connect(): Failed opening required '' (include_path='') in /home/name/public_html/robots.php on line 63
Reply With Quote
Old 30 Jul 2003, 23:38
MUG MUG is offline
Join Date: Apr 2002
Did you change $vB_Config_Path to the correct path?
Reply With Quote
Old 07 Oct 2003, 10:06
daFish's Avatar
daFish daFish is offline
Join Date: Nov 2002
Real name: Marcus
Great addition.
Ar their any plans for a new version?

Reply With Quote
Old 04 Nov 2003, 21:19
sabret00the's Avatar
sabret00the sabret00the is offline
Join Date: Jan 2003
Real name: sabe
nice little hack this
UNDER CONSTRUCTION: Confessionary Hack

Make me a Hack of The Month author: GRPS: Groups Commune
make my hacks, they'll make you famous

unless it's a security concern, please do not pm/im me for support unless you're willing to pay.
Reply With Quote
Old 12 Nov 2003, 20:00
gmarik's Avatar
gmarik gmarik is offline
Join Date: May 2002
Real name: Marco
.htaccess error

I wanted to have "club/rules"

RewriteEngine On
Options +FollowSymlinks
RewriteBase /
RewriteRule ^club/rules\/?$ /announcement.php?s=&forumid=10 but this does not works, other rewrites work, but I could not make it either with forum names (club/f12, club/f45 taking the ID's)
Reply With Quote
Old 01 Dec 2003, 15:00
peterska2 peterska2 is offline
Join Date: Oct 2003
Real name: Kerry-Anne (really!)
I like this idea but how do I create a .htaccess file?

Is it just an extension like .txt or .php ?

Or is it something completely different?

*blushes* Still a n00b to this *blushes*
Reply With Quote

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
Mod Options

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

New To Site? Need Help?

All times are GMT. The time now is 16:22.

Layout Options | Width: Wide Color: