User-Agents Database

User Agent Details of JCrawler

Name:	JCrawler
URL:	http://www.nihongo.org/jcrawler/
User Agent Key:	JCrawler
User Agents:	JCrawler/0.2
IP Ranges:
Adheres robots.txt:	Yes
Adheres META tag:	Yes
Type(s):	SearchEngine
Verified:	Yes
Info:	JCrawler is currently used to build the Vietnam topic specific WWW index for VietGATE . It schedules visits randomly, but will not visit a site more than once every two minutes. It uses a subject matter relevance pruning algorithm to determine what pages to crawl and index and will not generally index pages with no Vietnam related content. Uses Unicode internally, and detects and converts several different Vietnamese character encodings.
Date Added:	8/03/2004 0:37:42

User Agents - Search