 |
|
|
Mod Options |
robots.txt Manager Details »»
|
|||||||||
|
This modification is in the archives.
This script allows you to easily create a dynamically generated robots.txt file, based on specified rules.
If you use this hack, please click 'Install'  Screenshots will be attached... Download Now Only licensed members can download files, Click Here for more information. Show Your Support
No members have liked this post.
|
|||||||||
About Developer
Not Supported | Comments |
|
#2
08 Feb 2003, 20:00
|
|||
|
|||
|
Control Panel
No members have liked this post.
Last edited by MUG : 12 Apr 2003 at 15:00. 
|
|
#3
08 Feb 2003, 20:01
|
|||
|
|||
|
Editor (All Robots)
No members have liked this post.
Last edited by MUG : 12 Apr 2003 at 15:01.
|
|
#4
08 Feb 2003, 20:01
|
|||
|
|||
|
Editor (Specific Robot)
No members have liked this post.
Last edited by MUG : 12 Apr 2003 at 15:01.
|
|
#5
08 Feb 2003, 20:01
|
|||
|
|||
|
Generated File (:banana
No members have liked this post.
Last edited by MUG : 12 Apr 2003 at 15:04.
|
|
#6
08 Feb 2003, 20:08
|
||||
|
||||
|
Excellent G.
No members have liked this post.
|
|
#7
08 Feb 2003, 20:31
|
||||
|
||||
|
Wow very nice!
__________________
Dean Clatworthy - Web Developer/Designer No members have liked this post.
|
|
#8
08 Feb 2003, 21:04
|
||||
|
||||
|
very good job, tho' I can edit one txt file by hands
No offence, again, very good job May I ask you if you have the list with IPs of some major/all search engines? I kinda need it Thanx a lot and again, a nice hack!
__________________
It's nice to be important but it's more important to be nice. -------------------------------------------------------------------------------------------------------------------------------------------- Never discuss with an idiot, he'll just pull you down to his own level and beat you with experience! -------------------------------------------------------------------------------------------------------------------------------------------- Its not the penis that makes the man, its the way he uses it. No members have liked this post.
|
![wooolF[RM]'s Avatar](/custompics/forum/avatars/avatar4816_0.gif){kind=avatar}
|
#9
08 Feb 2003, 21:07
|
|||
|
|||
|
The point of the hack is to make administration easier. It keeps track of robots requesting the robots.txt file, allowing you to ban or restrict a bot without having to dig through the server logs. I wrote the hack today, so the only bots included in the database already are the ones that spidered my site during that time. The list is in the .sql file.
No members have liked this post.
|
|
#10
08 Feb 2003, 21:37
|
||||
|
||||
|
thanx for the answer
__________________
It's nice to be important but it's more important to be nice. -------------------------------------------------------------------------------------------------------------------------------------------- Never discuss with an idiot, he'll just pull you down to his own level and beat you with experience! -------------------------------------------------------------------------------------------------------------------------------------------- Its not the penis that makes the man, its the way he uses it. No members have liked this post.
|
|
#11
08 Feb 2003, 21:50
|
||||
|
||||
|
Is it suppose to write a new robots.txt file everytime or do the bots see the robots.php file as robots.txt?
If your answer is it's suppose to write a new robots.txt file, it isn't working for me :-( And: do I still need a robots.txt file? No members have liked this post.
|
|
#12
08 Feb 2003, 22:06
|
|||
|
|||
RewriteEngine on RewriteRule robots.txt /robots.php (note: this is for the old version. read the new install file )Upload robots.php to the root web directory (usually public_html). Make sure you run robots.sql using phpMyAdmin. No members have liked this post.
Last edited by MUG : 09 Feb 2003 at 17:23.
|
|
#13
08 Feb 2003, 22:33
|
||||
|
||||
|
I did that already
 So the robots are redirected to robots.php which is feeding them a perfectly rendered robots.txt file? Sorry 'bout asking, but I don't want to break my (high) ranking(s). - djr No members have liked this post.
|
|
#14
08 Feb 2003, 23:10
|
|||
|
|||
No members have liked this post.
|
|
#15
08 Feb 2003, 23:16
|
|||
|
|||
|
Thanks! I just installed it. See if I can control those bot's a little more!!
No members have liked this post.
|
|
«
Previous Mod
|
Next Mod
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) |
| Mod Options | |
|
|
| New To Site? | Need Help? |
All times are GMT. The time now is 09:21.