 Joined: Jan 2007 Posts: 498
 
 Brazil
|
Apr 07, 2008, 06:06:22 PM | #1 |
I am sick of Google search spiders. They index everything I don't want and miss the things I do want.
I have a private area for a client and they accesses it with a browser using Google toolbar and now Google has find and index the pages 
Is there a way to hide pages from the google spiders ? |
|
|
|
|
|
|
 Joined: Dec 2006 Posts: 123
 
 Netherlands
|
Apr 29, 2008, 01:03:13 PM | #2 |
make certain you or your client are not using the Google toolbar. It will spider any pages it finds.
you can use an .htaccess with username and password to protect pages. |
|
|
|
|
|
|
|
|
 Joined: Oct 2007 Posts: 209
The internet is my playground.

 United States
|
Jul 05, 2008, 03:01:05 PM | #5 |
If you do use the robots.txt file, make sure that you or your clients are not using the Google toolbar. Google has a habit of going where it shouldn't because of the toolbar finding links.
The best solution would be to use .htacces to password protect the content you don't want seen. |
|
Latest Blog Post :
The Advantages of Water-Powered Car Technology
|
|
|
 Joined: Jul 2008 Posts: 2
 
Israel
|
Jul 11, 2008, 02:21:23 PM | #6 |
You can also check in the "google webmaster tools" in the tools section a "remove url" tool, which enables you to define specific pages you wish google to exclude from its index.
|
|
|
|
|
 Joined: Jan 2007 Posts: 498
 
 Brazil
|
Jul 23, 2008, 05:13:18 PM | #7 |
I wanted to hide the content so Google doesn't know it exists so webmasters tools or robots.txt are out of the question.
I was thinking maybe PHP can do this ? |
|
|
|
|
|
|
|
|
|
|