|
|
|
|
|
User-Agents Database |
User Agent Details of stat
| Name: | stat |
| URL: | |
| User Agent Key: | statcrawler |
| User Agents: | stat statcrawler@gmail.com
|
| IP Ranges: | 66.92.186.* |
| Adheres robots.txt: | Yes |
| Adheres META tag: | N/A |
| Type(s): |
SearchEngine
|
| Verified: | | | Info: | Experimental search engine
stat is an experimental crawler for a next generation search engine like service, which would try to be webmaster friendly. It's interesting that it only got noticed by now after it has crawled tens of millions of pages. I haven't seen any complains (aside from a couple of curious inquiries) yet regarding it's behavior.
It adheres to the robots.txt instructions. The current minimum page fetch interval for a site is 30 seconds (there is no scheduled delay between the fetch of robots.txt and the first page.) I suspect most webmasters won't mind as there are zero complaints so far. The intention is to create a service that is mutually beneficial to the sites crawled and the service provider.
If you think it's misbehaving on your site, send a note to statcrawler@gmail.com and it'll be dealt with. | | Date Added: | 3/05/2006 22:18:23 | | |  |
User Agents - Search
|
|
