Icy Phoenix

     
 


Post new topic  This topic is locked: you cannot edit posts or make replies. 
Page 1 of 1
 
 
Reply with quote Download Post 
Post How Do I? 
 
my website that im using IP on is a private family tree website and i'm needing to remove or disable the google spiders...
from a legal standpoint the website isnt supposed to be advertised on any search engine due to us not having express written consent to have the info published of most of the extended family on the site. Please reply soon
 



 
marduukSend private message  
Back to topPage bottom
Icy Phoenix is an open source project, you can show your appreciation and support future development by donating to the project.

Support us
 
Reply with quote Download Post 
Post Re: How Do I? 
 
check this great explanation

http://www.webpronews.com/topnews/2...crawling-a-site
 




____________
? Zuker - EDDB - LPM - Sharefields
 
ZukerSend private messageVisit poster's website  
Back to topPage bottom
Reply with quote Download Post 
Post Re: How Do I? 
 
marduuk wrote: [View Post]
my website that im using IP on is a private family tree website and i'm needing to remove or disable the google spiders...
from a legal standpoint the website isnt supposed to be advertised on any search engine due to us not having express written consent to have the info published of most of the extended family on the site. Please reply soon

I would limit access only to registered users.
 




____________
Luca
SEARCH is the quickest way to get support.
Icy Phoenix ColorizeIt - CustomIcy - HON
 
Mighty GorgonSend private messageSend e-mail to userVisit poster's website  
Back to topPage bottom
Reply with quote Download Post 
Post Re: How Do I? 
 
Put into robots.txt (at the start of the file):

User-Agent:*
Disallow:*

User-Agent:*opera*
Allow:*

User-Agent:*ie*
Allow:*

User-Agent:*mozilla*
Allow:*

User-Agent:*nestcape*
Allow:*

And continue like this with all browsers.
 



 
novice programmerSend private message  
Back to topPage bottom
Reply with quote Download Post 
Post Re: How Do I? 
 
And with meta tags:

<META name="ROBOTS" content="NOINDEX">
<META name="ROBOTS" content="NOFOLLOW">
 



 
novice programmerSend private message  
Back to topPage bottom
Post new topic  This topic is locked: you cannot edit posts or make replies.  Page 1 of 1
 


Display posts from previous:    

HideWas this topic useful?

Link this topic
URL
BBCode
HTML




 
Permissions List
You cannot post new topics
You cannot reply to topics
You cannot edit your posts
You cannot delete your posts
You cannot vote in polls
You cannot attach files
You can download files
You cannot post calendar events


  

 

  cron