Register Members List Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
  #1  
Old 29 May 2011, 07:09
Weeds Weeds is offline
 
Join Date: Apr 2010
What Robot txt should i have? Google Webmaster blocking 11 000 URL

I wonder what google Robot.txt i should i have. At the moment i have a Robot.txt but in the root it is just blocking my wordpress that i have on blog.domain.com.

Google webmaster is blocking this kind of threads


/tags.php?tag=investment+in+thailand URL restricted by robots.txt

/threads/2207-Obama-Visit-To-Indonesia?p=2389 URL restricted by robots.txt


Should the VB block these?
Reply With Quote
  #2  
Old 29 May 2011, 07:30
Brandon Sheley's Avatar
Brandon Sheley Brandon Sheley is offline
 
Join Date: Mar 2005
Real name: Brandon
so you're asking if you should blog tags or one thread?
you can look at mine as an example....
__________________
Do you have questions about managing a forum, check out my Admin Forum.
*NEW* Our latest Interview with Scott Molinari - from: vb-Germany!
Trying to offer vBulletin 5 Connect info as well.
Reply With Quote
  #3  
Old 29 May 2011, 08:57
Weeds Weeds is offline
 
Join Date: Apr 2010
I do not even have a robot for my VB and i do not know why it blocking these URL there is 11 000 now. I see you not blocking tags and threads.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
Forum Jump


New To Site? Need Help?

All times are GMT. The time now is 06:25.

Layout Options | Width: Wide Color: