https://www.icyphoenix.com/viewtopic.php?f=35&t=2814
-----------------------------------
marduuk
Mon 17 Sep, 2007 17:31

How Do I?
-----------------------------------
my website that im using IP on is a private family tree website and i'm needing to remove or disable the google spiders...
from a legal standpoint the website isnt supposed to be advertised on any search engine due to us not having express written consent to have the info published of most of the extended family on the site. Please reply soon


-----------------------------------
Zuker
Wed 19 Sep, 2007 01:20

Re: How Do I?
-----------------------------------
check this great explanation

http://www.webpronews.com/topnews/2004/03/31/disabling-google-and-other-search-engines-from-crawling-a-site


-----------------------------------
Mighty Gorgon
Thu 20 Sep, 2007 23:41

Re: How Do I?
-----------------------------------
[quote user="marduuk" post="19761"]my website that im using IP on is a private family tree website and i'm needing to remove or disable the google spiders...
from a legal standpoint the website isnt supposed to be advertised on any search engine due to us not having express written consent to have the info published of most of the extended family on the site. Please reply soon[/quote]
I would limit access only to registered users.


-----------------------------------
novice programmer
Sat 22 Sep, 2007 00:11

Re: How Do I?
-----------------------------------
Put into robots.txt (at the start of the file):

User-Agent:*
Disallow:*

User-Agent:*opera*
Allow:*

User-Agent:*ie*
Allow:*

User-Agent:*mozilla*
Allow:*

User-Agent:*nestcape*
Allow:*

And continue like this with all browsers.


-----------------------------------
novice programmer
Sat 22 Sep, 2007 00:13

Re: How Do I?
-----------------------------------
And with meta tags:

<META name="ROBOTS" content="NOINDEX"> 
<META name="ROBOTS" content="NOFOLLOW">


