 |
|
|
Mod Options |
Have Googlebot Crawl EVERYTHING (theoretically) Details »
|
|||||||||||
|
Have Googlebot Crawl EVERYTHING (theoretically)
Developer Last Online: May 2007 
This modification is in the archives.
Googlebot supposedly won't crawl links that have sessionhashes (32 character hex strings) in the URLs. So this hack detects when Googlebot is browsing your forum, and if it is, deletes the sessionhash. So, theoretically, Googlebot will be able to crawl every single guest-accessible link on your board. All of them. This means every thread, every forum, every post, even useless stuff like the memberlist and the FAQ.
Simple to install (1 step). This won't get instant gratification because Googlebot will only reindex your site on its next crawl. Download Now Only licensed members can download files, Click Here for more information. Show Your Support
No members have liked this post.
|
|||||||||||
About Developer
Visit Web Site
Not Supported | Comments |
|
#2
25 Mar 2003, 19:00
|
|||
|
|||
|
Another great hack filburt1. Not sure I need it crawling my internal site, but nevertheless very cool.
No members have liked this post.
|
|
#3
25 Mar 2003, 19:22
|
||||
|
||||
|
lol so thats why u wanted the sessions code
No members have liked this post.
|
|
#4
25 Mar 2003, 19:38
|
|||
|
|||
|
No it's not...
No members have liked this post.
|
|
#5
25 Mar 2003, 19:54
|
|||
|
|||
|
simple but very effective hack , thanks :-)
No members have liked this post.
|
|
#6
25 Mar 2003, 20:02
|
|||
|
|||
|
Sounds good thanks Filburt
No members have liked this post.
|
|
#7
25 Mar 2003, 20:35
|
||||
|
||||
|
Excellent
 One note: This may not allow Google to see all of your posts (theoretically). If you have old ones that would not naturally show up on forumdisplay, Google will not use the select box to see all of the old posts. Elegantly simple though and makes perfect sense. /me clicks install
__________________
Marijuana Growing Magazine - since vB 1.1 No members have liked this post.
|
|
#8
25 Mar 2003, 20:42
|
|||
|
|||
|
Filburt how did you find that special part of code through all that 'mess'?
   .Thanks. *Installs*. Dave.
__________________
dgane.com - about me & my life No members have liked this post.
Last edited by Davey; 25 Mar 2003 at 20:45.
|
|
#9
25 Mar 2003, 22:31
|
|||
|
|||
|
On my site I require registration for users to view threads. Is there a way to allow Google to become a "registered" user so it can crawl all threads still?
__________________
Australian eCommerce Community No members have liked this post.
|
|
#10
25 Mar 2003, 22:32
|
|||
|
|||
|
Yes but smart users can get around it...
edit: actually I thought of a way to fix that, too. Expect that hack eventually. note to self: check first few IP bits and HTTP_USER_AGENT, update $bbuserinfo. No members have liked this post.
|
|
#11
25 Mar 2003, 22:35
|
||||
|
||||
|
installed
nice one off topic how r u lot doing those funky sigs ? i beleive u started the trend filb ! No members have liked this post.
|
|
#12
25 Mar 2003, 22:37
|
|||
|
|||
|
I dont really mind if a smart user can get in without registering - my forums arent private I just like to know who is using them. But the true value is of course in having as many threads as possible in Google to attract new users.
__________________
Australian eCommerce Community No members have liked this post.
|
|
#13
26 Mar 2003, 02:21
|
||||
|
||||
|
Nice hack, and I'll be awaiting that suggestion by Webdork in post #9 as well
/me clicks install
__________________
My OpenSource (as in do with them what you want no need to ask for permission) Scripts: 7/25/04 » Article Bot 1.1, vB3 Member Album 2.0, BB Code Functions, Advanced Search w/Member Conditions, Eggdrop IRC Manager, IRC Manager for mIRC, Existing Topics Check http://www.mozilla.org/products/fire...efox_80x15.png No members have liked this post.
|
|
#14
26 Mar 2003, 03:42
|
|||
|
|||
|
Forgot it, I can't stand looking at sessions.php after trying for an hour.
No members have liked this post.
|
|
#15
26 Mar 2003, 19:31
|
|||
|
|||
|
Hmm, theres a similar hack for this in Tech's vB Archive hack that also includes several searchbots, not just google.
No members have liked this post.
|
|
«
Previous Mod
|
Next Mod
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Mod Options | |
|
|
| New To Site? | Need Help? |
All times are GMT. The time now is 02:32.
Powered by vBulletin® Version 3.8.14
Copyright © 2021, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Copyright © 2021, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Design by Princeton
Copyright ©2001 - , vbulletin.org. All rights reserved.
vBulletin® is a registered trademark. 