|
|
|
|
User-Agents Database |
User Agent Details of NetCarta WebMap Engine
Name: | NetCarta WebMap Engine |
URL: | http://www.netcarta.com/ |
User Agent Key: | NetCarta CyberPilot |
User Agents: | NetCarta CyberPilot Pro
|
IP Ranges: | |
Adheres robots.txt: | Yes |
Adheres META tag: | N/A |
Type(s): |
DataMiningPublic IndexingTool OfflineBrowser LinkChecking
|
Verified: | | Info: | The NetCarta WebMap Engine is a general purpose, commercial spider. Packaged with a full GUI in the CyberPilo Pro product, it acts as a personal spider to work with a browser to facilitiate context-based navigation. The WebMapper product uses the robot to manage a site (site copy, site diff, and extensive link management facilities). All versions can create publishable NetCarta WebMaps, which capture the crawled information. If the robot sees a published map, it will return the published map rather than continuing its crawl. Since this is a personal spider, it will be launched from multiple domains. This robot tends to focus on a particular site. No instance of the robot should have more than one outstanding request out to any given site at a time. The User-agent field contains a coded ID identifying the instance of the spider; specific users can be blocked via robots.txt using this ID. | Date Added: | 25/07/2005 0:59:30 | | |
User Agents - Search
|
|