Register Members List Search Today's Posts Mark Forums Read

Reply
 
Mod Options
Have Googlebot Crawl EVERYTHING (theoretically) Details »
Have Googlebot Crawl EVERYTHING (theoretically)
Mod Version: 1.00, by filburt1 (Member) filburt1 is offline
Developer Last Online: May 2007 I like it Show Printable Version Email this Page

This modification is in the archives.
vB Version: 2.3.x Rating: (1 vote - 5.00 average) Installs: 107
Released: 25 Mar 2003 Last Update: Never Downloads: 78
Not Supported Is in Beta Stage  

Googlebot supposedly won't crawl links that have sessionhashes (32 character hex strings) in the URLs. So this hack detects when Googlebot is browsing your forum, and if it is, deletes the sessionhash. So, theoretically, Googlebot will be able to crawl every single guest-accessible link on your board. All of them. This means every thread, every forum, every post, even useless stuff like the memberlist and the FAQ.

Simple to install (1 step). This won't get instant gratification because Googlebot will only reindex your site on its next crawl.

Download Now

Only licensed members can download files, Click Here for more information.

Show Your Support

  • To receive notifications regarding updates -> Click to Mark as Installed.
  • This modification may not be copied, reproduced or published elsewhere without author's permission.
  #16  
Old 26 Mar 2003, 19:33
filburt1 filburt1 is offline
 
Join Date: Feb 2002
This is one file edit, don't think you need to install that beast...
Reply With Quote
  #17  
Old 26 Mar 2003, 19:41
Slynderdale Slynderdale is offline
 
Join Date: Mar 2002
Real name: John
You dont need to install vB Archive for the sessionhash stripping, you can find it in this post:
http://www.vbulletin.org/forum/showt...706#post342706

Just add a small function to functions.php and edit global.php and it strips all sessionhash's from search bots.

Also nice hack though filburt.

Last edited by Slynderdale; 26 Mar 2003 at 19:45.
Reply With Quote
  #18  
Old 26 Mar 2003, 22:53
CityInet's Avatar
CityInet CityInet is offline
 
Join Date: Feb 2003
this is not working for me. At the top of my home page I get...
if (strpos(strtolower($_SERVER['HTTP_USER_AGENT']), "googlebot") != false) { unset($session['sessionhash']); }

any suggestions?
__________________
-City
www.warvoice.com
Reply With Quote
  #19  
Old 26 Mar 2003, 23:04
filburt1 filburt1 is offline
 
Join Date: Feb 2002
Read the instructions again.
Reply With Quote
  #20  
Old 27 Mar 2003, 05:00
DWZ's Avatar
DWZ DWZ is offline
 
Join Date: Dec 2001
Real name: Alan
Yesterday at 08:35 AM corsacrazy said this in Post #11
off topic

how r u lot doing those funky sigs ? i beleive u started the trend filb !
ummmm... how did you do that? lol

EDIT: found the hack

Last edited by DWZ; 27 Mar 2003 at 11:45.
Reply With Quote
  #21  
Old 27 Mar 2003, 05:39
Grunt Grunt is offline
 
Join Date: Aug 2002
so this will do everything that the VBarchive hack will do with one file edit?
Reply With Quote
  #22  
Old 27 Mar 2003, 16:13
filburt1 filburt1 is offline
 
Join Date: Feb 2002
Well, it has the same objective as vBArchive, it doesn't do everything it does.
Reply With Quote
  #23  
Old 27 Mar 2003, 16:24
Grunt Grunt is offline
 
Join Date: Aug 2002
i recall that only 1 of the many steps of VBArchive was to remove the sessionhash's, that is why i ask
Reply With Quote
  #24  
Old 04 Apr 2003, 06:55
MaXxed MaXxed is offline
 
Join Date: Jun 2002
How is this working for everyone? Any results? I have it installed and saw a crawler today, but it didnt stay long....
Reply With Quote
  #25  
Old 09 Apr 2003, 16:52
filburt1 filburt1 is offline
 
Join Date: Feb 2002
Googlebot is swarming my forums right now so when the index is updated we should know if this works.
Reply With Quote
  #26  
Old 09 Apr 2003, 18:06
amykhar's Avatar
amykhar amykhar is offline
 
Join Date: Oct 2001
Real name: Amy
I have filbert1's template mod installed; therefore Google has already been crawling a lot of stuff. However, it never picked up the calendar or faq before. I put this hack in, and now my calendar is indexed on Google.

Amy
__________________
amykhar.com
----------------------------------------
I do not respond to PM requests for coding assistance.
Reply With Quote
  #27  
Old 09 Apr 2003, 18:26
Smoothie Smoothie is offline
 
Join Date: Oct 2001
and google is registering, once again.
Reply With Quote
  #28  
Old 10 Apr 2003, 05:00
MaXxed MaXxed is offline
 
Join Date: Jun 2002
So far im showing no significant increase in google links, unfortunately. I will give it more time
Reply With Quote
  #29  
Old 10 Apr 2003, 15:37
mymilkexpired mymilkexpired is offline
 
Join Date: Mar 2003
any movement on this? i would like to know how effective it is to gauge whether or not i should install it! thanks...
Reply With Quote
  #30  
Old 14 Apr 2003, 02:11
MaXxed MaXxed is offline
 
Join Date: Jun 2002
Well after installing this, my google links dropped by 100, from 696 to 595. I was getting better results from a simple sitemap.

Not sure why this is, but obviously it doesnt work? Will wait for comments before uninstalling, but will take a month to fix the results with google.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Mod Options

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 03:14.

Layout Options | Width: Wide Color: