Icy Phoenix

Old Support Topics - How Do I?

marduuk [ Mon 17 Sep, 2007 17:31 ]
Post subject: How Do I?

my website that im using IP on is a private family tree website and i'm needing to remove or disable the google spiders...
from a legal standpoint the website isnt supposed to be advertised on any search engine due to us not having express written consent to have the info published of most of the extended family on the site. Please reply soon

Zuker [ Wed 19 Sep, 2007 01:20 ]
Post subject: Re: How Do I?

check this great explanation

http://www.webpronews.com/topnews/2...crawling-a-site

Mighty Gorgon [ Thu 20 Sep, 2007 23:41 ]
Post subject: Re: How Do I?

marduuk wrote: [View Post]
my website that im using IP on is a private family tree website and i'm needing to remove or disable the google spiders...
from a legal standpoint the website isnt supposed to be advertised on any search engine due to us not having express written consent to have the info published of most of the extended family on the site. Please reply soon

I would limit access only to registered users.

novice programmer [ Sat 22 Sep, 2007 00:11 ]
Post subject: Re: How Do I?

Put into robots.txt (at the start of the file):

User-Agent:*
Disallow:*

User-Agent:*opera*
Allow:*

User-Agent:*ie*
Allow:*

User-Agent:*mozilla*
Allow:*

User-Agent:*nestcape*
Allow:*

And continue like this with all browsers.

novice programmer [ Sat 22 Sep, 2007 00:13 ]
Post subject: Re: How Do I?

And with meta tags:

<META name="ROBOTS" content="NOINDEX">
<META name="ROBOTS" content="NOFOLLOW">