https://www.icyphoenix.com/viewtopic.php?f=4&t=2950&p=20543#p20543
-----------------------------------
novice programmer
Tue 16 Oct, 2007 18:02

SEO - Robots list
-----------------------------------
This topic is for help ban of spam and un-wanted robots. use this with [url=http://www.icyphoenix.com/viewtopic.php?f=4&t=1529]this other topic: (Mail Spammers list and spam users)

As some people don´t want their sites indexed by any search robot/engine, I started this topic for reporting search robots.
There are some robots that ignore the disallow or go to that directories. Also there are ons that recopilate the "mailto:" HTML´s lines and send spam to that adresses.

Please, use this format for the robot reporting:

[cell class=mg_codetitle]Good/Bad robot:[/cell][cell class=mg_quotediv]
Ip/s that the robot uses:
The user-agent the robot gives:
Why it is good or bad:
Other data:
 
[/cell]

I don´t mind if cells are not used, but use the horizontal lines if you´re going to report various engines in same post.


