|
|
|
|
|
User-Agents Database |
User Agent Details of IRLbot
| Name: | IRLbot |
| URL: | http://irl.cs.tamu.edu/crawler |
| User Agent Key: | IRLbot |
| User Agents: | TAMU_CS_IRL_CRAWLER/1.0
IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler)
IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
|
| IP Ranges: | |
| Adheres robots.txt: | Yes |
| Adheres META tag: | Yes |
| Type(s): |
DataMiningCommercial
|
| Verified: | Yes | | Info: | IRL-crawler is a Texas A&M research project sponsored in part by the National Science Foundation that investigates algorithms for mapping the topology of the Internet and discovering the various parts of the web. The crawler downloads random web pages (text only) and follows certain links to find other websites. | | Date Added: | 2/05/2006 0:42:29 | | |  |
User Agents - Search
|
|
