SEO Problems

Permalink
I am getting a huge amount of "keywords" in Google Webmaster that are "php", "concrete","libraries" etc.

This is making it nearly impossible to SEO our site when we have to compete with all of those "keywords"

I am also getting 99 pages "Not Found" and a lot of "soft 404's"

It seems to be that a lot of my url's are being found by Google like this:

http://hotmotorcyclehelmets.com/helmets/shorty-helmet/http://hotmot...
(notice that the url's are being duplicated at the end)

I've gone through the site several times and for the life of me can not find these url's

No idea how to fix this!

norsemengrp
 
smartwebprojects replied on at Permalink Reply
smartwebprojects
I haven't found the reason for second problem (double http in the link), but for "php" and "concrete5" keywords the issue is simple: Google has indexed the contents ofhttp://hotmotorcyclehelmets.com/updates/051110/...

I think you should add the following line to robots.txt:

Disallow: /updates/
norsemengrp replied on at Permalink Reply
norsemengrp
Thank you for the help with the robots.txt. I fixed that and can only wait and see about the keywords in Analytics.

Still no joy on the duplicate url thing?
AuntieBirdy replied on at Permalink Reply
AuntieBirdy
My post is not in relation to SEO, more of a security issue.

In addition to disallowing updates, have the perms changed so none of the directories or files within the tree can be browsed through. I just took a look at your db schema. Some people would argue it is no big deal to have that information out there, I think it is. If anyone tries to access those directories of files they should be getting a forbidden error.
somenboll replied on at Permalink Reply
Have you registered the sitemap.xml file in the Google Webmasters tools?

Remember that changes made on your website will take some time to show in the Webmaster tools =)
linuxoid replied on at Permalink Reply
linuxoid
My host has cPanel which has got an Index Manager:

"The Index Manager allows you to customize the way a directory will be viewed on the web. You can select between a default style, no indexes, or two types of indexing. If you do not wish for people to be able to see the files in your directory, choose no indexing."

Do you have cPanel?

I think the same can be done with .htaccess files (sorry don't know how though).