Thread: Google crawler
View Single Post
  #1  
Old 26 Jan 2017, 18:08
fernandofgg fernandofgg is offline
 
Join Date: Jan 2017
Talking Google crawler

Hi everybody

Appart from robots.txt in the root directory, is there any other place in admincp that I can block spiders for crawling specific forums

My question is because I have a forum that dont appear on google searches, maybe the old administrator block this forum from crawling but the strange thing is that I dont have robots.txt in the root directory, thats mean google is 100% opened to crwal the site

Where in admincp can block spiders for crawling specific forums?

Thanks in advance
Reply With Quote