|
|
|
|
User-Agents Database |
User Agent Details of Heritrix
Name: | Heritrix |
URL: | http://crawler.archive.org/ |
User Agent Key: | heritrix |
User Agents: | heritrix/2.0.2 +http://www.adsafemedia.com Mozilla/5.0 (compatible; heritrix/3.1.1 +http://www.baidu.com) mozilla/5.0 (compatible; heritrix/1.2.0 +http://www.cs.washington.edu/research/networking/websys/) mozilla/5.0 (compatible; heritrix/1.3.0 +http://archive.crawler.org) Mozilla/5.0 (compatible; heritrix/1.10.1 +http://www.cs.washington.edu/homes/raphaelh) Mozilla/5.0 (compatible; woriobot heritrix/1.10.0 +http://worio.com)
|
IP Ranges: | |
Adheres robots.txt: | N/A |
Adheres META tag: | N/A |
Type(s): |
IndexingTool OfflineBrowser
|
Verified: | Yes | Info: | Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. | Date Added: | 8/02/2004 0:05:08 | | |
User Agents - Search
|
|