Webmaster Help
|
Welcome, Guest. Please login or register.
Did you miss your activation email?
Nov 21, 2008, 12:04:52 AM

Login with username, password and session length

Learn from yesterday, live for today, hope for tomorrow. The important thing is not to stop questioning.


- Albert Einstein

Welcome Guest - Register or Login Now to remove these advertisments


Registration is completely free and only takes a few minutes to signup !

|-   Entrepreneur Forum > Webmasters - Discuss Making Money Online > Website Design and Maintenance
+   How do I block subdomain from search engine indexing?
0 Members and 1 Guest are viewing this topic.
Pages: [1] Reply to Thread
Author Topic: How do I block subdomain from search engine indexing?  (Read 277 times)
OfflineJRcopy
Junior Member
JRcopy is on a distinguished road
Joined: Sep 2007
Posts: 71



View JRcopy\s Profile
United States
notepad Feb 23, 2008, 09:20:05 PM #1
didn't know where to ask this so I'm asking it here

=====

If I  have the domain say http:// www.testdomain.com.
I wanted to add a subdomain only for working on and testing my site, say that is http:// work.testdomain.com. Now when sombody hits http:// work.testdomain.com the page comed served out from a folder in domain's root folder called "work".

I do not want Google or any other search engine to index or browse any of those subdomains. I know from past experience that Alexa toolbar and Google toolbar index sites viewed by their users.

 I have excluded the directory "work" in the robots.txt file. Did I do the right thing and is there anything else I can do or should be doing to avoid the se's from indexing this subdomain?

I want the subdomain to be viewable but not indexed because I don't want trouble with duplicate content.

thanks for any answers

\|||/ |----- Get The Insider Secrets To -----| \|||/
('o') | Making Multiple Streams Of Income | ('o')
() () | With PROFITABLE Mini Sites! -- Free! | () ()
Offlineumat_gila
Code4Gold Icon
umat_gila is on a distinguished road
Joined: Oct 2006
Posts: 2059


Avatar of umat_gila

Nothing Impossible Is just Possible Yet.

View umat_gila\s ProfileWWW
Gender: MaleGemini Hong Kong
notepad Feb 23, 2008, 09:35:33 PM #2
I know what you mean here. And for me using robots.txt is enough to block. But after i have thingkin again for create a few line in httpd.conf is good too.
I have try yet about this issue, just lookin forward as my experience after installing Wp Mu two days a go...

hope this one could help you :)

Latest Blog Post : Another Time To Show Off

Count Us To be a Winner on busby seo test page contest
please make a link to Indonesia Webbies For Help Us To Be A Busby Seo Test Winner
Online~Dave~
Administrator
~Dave~ is a jewel in the rough~Dave~ is a jewel in the rough~Dave~ is a jewel in the rough~Dave~ is a jewel in the rough
Joined: Jan 2006
Posts: 6175


Avatar of code4gol

Go Phillies !!

View ~Dave~\s ProfileWWW
Gender: MaleGemini United States
notepad Feb 24, 2008, 02:42:50 AM #3
The proper way to do this is put a robots.txt file in the subdomain's main folder (ie: "work" in your example). It should contain the following...

Code:
User-agent: *
Disallow: /

be aware, this robots.txt file is telling the search engines to totally ignore anything served from that document root at that subdomain

Here's some basic tutorial stuff:
If you have the subdomain pointed at the "work" directory in the main domains folder, your main site no longer controls permissions for that subdomain/subdirectory. The webserver sees it as if it were it's own individual website (not a webpage). That's why this is very useful to make a site like testing.mywebsite.com for your domain mywebsite.com and do your work on the test domain and then copy any changes over to the live site.

Very good question.

Latest Blog Post : Insights Marketing With Google Insights for Search

Pages: [1] Reply to Thread


Code4Gold Affiliate Entrepreneur Moneymaker Forum © 2006-2008 Resdaz Media LLC - All Rights Reserved

Forum Software Powered by SMF - © 2001-2008, Lewis Media. All Rights Reserved.