google is going to town indexing all the concrete directories
Permalink
they are indexing files like:
concrete/blocks/form/db.xml
and :
concrete/js/tiny_mce_309/plugins/table/merge_cells.htm
Is there any way to stop this via .htaccess? I know how to stop them from indexing via robots.txt, but shouldn't it be done via .htaccess if possible?
concrete/blocks/form/db.xml
and :
concrete/js/tiny_mce_309/plugins/table/merge_cells.htm
Is there any way to stop this via .htaccess? I know how to stop them from indexing via robots.txt, but shouldn't it be done via .htaccess if possible?
I disallowed dir indexing:
Options -indexes
in the .htaccess
also added the /concrete directory to the robots.txt disallow statement...
so combined, these should fix my issue.
Options -indexes
in the .htaccess
also added the /concrete directory to the robots.txt disallow statement...
so combined, these should fix my issue.
http://www.concrete5.org/index.php?cID=3621
I looked at my other CMS installations that I've done, and noticed that they have included a robots.txt in the distribution, with exclusions for all the "system" directories the CMS used...
Just suggesting that maybe Concrete 5 could include one of these in the distribution as well:)
Just suggesting that maybe Concrete 5 could include one of these in the distribution as well:)
I tend to drop a one line .htaccess in any folder tree that I want to deny access to, which contains this line:
deny from all
deny from all
could you plut this in context?
i'm new at .htaccess type stuff, and would like to see this line with some sample page-tree directory.. please?
i'm new at .htaccess type stuff, and would like to see this line with some sample page-tree directory.. please?
It seems odd that it would be indexing those files...as you would have to have linked to them from somewhere in order for google to find them...