| User Agent | | Verified | Date Added |
| CyberPatrol SiteCat Webbot |  | | 1/12/2008 1:15:05 |
|
| CCBot | | | 1/12/2008 1:14:23 |
|
| CentiverseBot | | | 1/12/2008 1:13:03 |
|
| FeedBurner | | | 1/12/2008 0:51:26 |
|
| Zook Knight | | | 1/12/2008 0:49:16 |
|
| LucidMedia ClickSense | | | 1/12/2008 0:48:19 |
|
| BebopBot | | | 1/12/2008 0:46:59 |
| BebopBot is an experimental web crawler under development since January 2007. BebopBot is owned and operated by A Passion for Jazz!™ as part of an effort to develop a niche based searchable Web index. We are not attempting to steal any copyrighted information from your site and will not be re-distributing your content. We will only be allowing users to find your website more easily. The information gathered will be indexed and made accessible via one or more publicly accessible web sites in the near future. |
| Akamix | | | 1/12/2008 0:44:59 |
|
| BarcaPro | | | 1/12/2008 0:43:33 |
|
| A1 Sitemap Generator | | | 1/12/2008 0:41:52 |
| Create Text, HTML, RSS and XML sitemaps for your website. |
| Firebat | | | 1/10/2008 12:45:11 |
|
| FeelBot | | | 9/09/2008 14:18:45 |
|
| CatchBot | | | 9/09/2008 13:55:03 |
CatchBot is the web crawler for Catch, the online division of Reed Business Information Australia. Reed Business Information is Australia’s leading and largest business to business publisher and information provider.
CatchBot investigates websites for publicly available information about companies, such as a company’s name, address, telephone number and keyword data about a company’s products and services. CatchBot is not designed to access or index any personal information or any information about individuals.
Information gathered by CatchBot is stored on our password protected servers and the security of this information is of the highest importance to us.
Information gathered by CatchBot may be used for business activities that are undertaken by Catch. Examples of this include publishing and maintaining business directories in various countries around the world, industry specific websites and online portals |
| DotBot | | | 25/08/2008 14:06:19 |
| fell for bad bot trap |
| NameOfAgent (CMS Spider) | | | 20/08/2008 16:28:55 |
| Searches for Wordpress wp-login.php and mod_login.xml |
| Onetime ShopFinder Program | | | 8/08/2008 13:51:08 |
|
| AideRSS | | | 25/07/2008 12:28:36 |
| Use PostRank™ to score, filter and track performance of any RSS feed. Reclaim your time, boost your productivity, and stay on top of the news. |
| Semager | | | 18/07/2008 0:33:31 |
| Die Semager-Bots sind Webcrawler unserer Suchmaschine. Dabei handelt es sich um Computerprogramme, die Texte im World Wide Web herunterladen und diese über die Web- und Wörtersuche von Semager auffindbar machen. |
| InkMonkey | | | 17/07/2008 0:43:50 |
| does a request with Content-Type: text/html; charset=utf-8 |
| WebAlta Crawler | | | 17/07/2008 0:25:55 |
| fell for bad bot trap + url is not working + e-mail harvesting ip addresses |
| WebDataCentreBot | | | 11/07/2008 16:29:48 |
| fell for bad bot trap + aggressive (2 requests/second) |
| RssBandit | | | 3/07/2008 23:27:13 |
|
| MarkAny WebSafer | | | 1/07/2008 15:37:02 |
MarkAny is a Korean rights management company.
WebSafer is their web content protection system.
ActiveX client control requests "/MarkAny/Websafer/MaSiteInfo.ini".
A reverse proxy is installed in front of the web server with content that needs protection. When a web browser wants access to protected content, it will first be presented with an ActiveX control to be installed.
The ActiveX control:
- installs "automatically".
- switches between protected and unprotected mode automatically;
probably why it requests the file /MarkAny/Websafer/MaSiteInfo.ini
- removes view source, print, and clipboard actions from menus.
- removes visits to protected pages from the browser history.
- removes access to right-click context menu.
- tries to stop screen capture programs.
|
| YahooFeedSeeker | | | 26/06/2008 0:33:37 |
|