|
|
|
|
User-Agents Database |
User Agent Details of Steeler
Name: | Steeler |
URL: | http://www.tkl.iis.u-tokyo.ac.jp/~crawler/ |
User Agent Key: | Steeler/ |
User Agents: | Steeler/2.0 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Steeler/3.1 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Steeler/3.2 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
|
IP Ranges: | |
Adheres robots.txt: | Yes |
Adheres META tag: | Yes |
Type(s): |
DataMiningPublic
|
Verified: | Yes | Info: | Steeler is a web crawler (aka robot), software to surf the web automatically. It is being developed and operated at Kitsuregawa Laboratory, The University of Tokyo. We are working on analysis and understanding of the nature of cyberspace based on the documents collected through the surfing. | Date Added: | 7/06/2004 11:46:38 | | |
User Agents - Search
|
|