RSBot is a new generation web spider bot. RS robot only signature is: Mozilla/5.0 (RSBot-0.1; http://randall.spb.ru/rsbot.html) RS robot should come to your site only from ip of this server, 91.196.252.169
This software is using for educational/statistic targets, and, probably, we will open a little search engine based on harvest results. Please check back our pages soon.
To disable indexing of your site, use the following lines: User-agent: RSBot Disallow: / |