didn't know where to ask this so I'm asking it here
=====
If I have the domain say http:// www.testdomain.com. I wanted to add a subdomain only for working on and testing my site, say that is http:// work.testdomain.com. Now when sombody hits http:// work.testdomain.com the page comed served out from a folder in domain's root folder called "work".
I do not want Google or any other search engine to index or browse any of those subdomains. I know from past experience that Alexa toolbar and Google toolbar index sites viewed by their users.
I have excluded the directory "work" in the robots.txt file. Did I do the right thing and is there anything else I can do or should be doing to avoid the se's from indexing this subdomain?
I want the subdomain to be viewable but not indexed because I don't want trouble with duplicate content.
thanks for any answers
\|||/ |----- Get The Insider Secrets To -----| \|||/ ('o') | Making Multiple Streams Of Income | ('o') () () | With PROFITABLE Mini Sites! -- Free! | () ()
I know what you mean here. And for me using robots.txt is enough to block. But after i have thingkin again for create a few line in httpd.conf is good too. I have try yet about this issue, just lookin forward as my experience after installing Wp Mu two days a go...
The proper way to do this is put a robots.txt file in the subdomain's main folder (ie: "work" in your example). It should contain the following...
Code:
User-agent: * Disallow: /
be aware, this robots.txt file is telling the search engines to totally ignore anything served from that document root at that subdomain
Here's some basic tutorial stuff: If you have the subdomain pointed at the "work" directory in the main domains folder, your main site no longer controls permissions for that subdomain/subdirectory. The webserver sees it as if it were it's own individual website (not a webpage). That's why this is very useful to make a site like testing.mywebsite.com for your domain mywebsite.com and do your work on the test domain and then copy any changes over to the live site.
| 
Feb 23, 2008, 09:20:05 PM
