| User Agent | | Date Added |
| Jobot |  | 8/03/2004 0:43:30 |
| Its purpose is to generate a Resource Discovery database. Intended to seek out sites of potential "career interest". Hence - Job Robot. |
| Jyxobot | | 7/10/2006 1:10:36 |
|
| KDD-Explorer | | 8/03/2004 0:52:56 |
KDD-Explorer is used for indexing valuable documents which will be retrieved via an experimental cross-language search engine, CLINKS.
This robot was designed in Knowledge-bases Information processing Laboratory, KDD R&D Laboratories, 1996-1997 |
| Kenjin Spider | | 8/09/2006 0:56:01 |
|
| Keywen Encyclopedia Bot | | 8/02/2004 15:32:44 |
| Keywen Bot is a program that is looking for short recognizable phrases on different websites (all over the Internet) in order to create Keywen links to these sites. |
| KIT Fireball | | 10/02/2004 1:27:02 |
| The Fireball robots gather web documents in German language for the database of the Fireball search service. |
| Knowledge.com | | 7/01/2005 17:15:41 |
|
| KO_Yappo_Robot | | 8/03/2004 1:01:34 |
| The KO_Yappo_Robot robot is used to build the database for the Yappo search service by k,osawa (part of AOL). The robot runs random day, and visits sites in a random order. |
| Kolibri | | 10/02/2004 1:32:55 |
|
| kuloko-bot | | 8/02/2004 19:50:24 |
| contextual search |
| LexiBot | | 8/09/2006 11:48:18 |
|
| libWeb/clsHTTP | | 8/09/2006 11:49:55 |
|
| LNSpiderguy | | 8/02/2004 16:14:50 |
|
| Look.com | | 8/02/2004 16:15:37 |
|
| lufsbot | | 13/07/2013 9:44:15 |
| Fake search engine (no results in search). |
| Lycos | | 10/02/2004 1:28:58 |
| Sometimes empty user agent |
| MarcoPolo | | 8/02/2004 16:20:20 |
|
| MARTINI | | 8/02/2004 16:17:32 |
|
| marvin/infoseek | | 24/07/2005 22:57:04 |
| day of birth: 4.2. 2001 - replaces Infoseek Sidewinder |
| MaSagool | | 2/08/2007 23:13:10 |
|
| Mata Hari | | 8/09/2006 11:58:23 |
| is now LexiBot |
| Mavicanet | | 8/02/2004 16:20:45 |
| Multilingual Search Catalog |
| Miva | | 3/05/2006 0:04:10 |
| MIVA is the new name for Espotting and the FindWhat.com Group. We are now one company, with one brand and one mission - to help businesses grow. |
| MJ12bot | | 16/11/2004 19:21:32 |
|
| mnoGoSearch search engine software | | 25/07/2005 0:39:06 |
mnoGoSearch search engine software (formerly known as UDMSearch) is an advanced search solution for large-scale websites and Intranet. It is based on SQL database and supports numerous features.
Formerly known as UDMSearch was developed as the search engine for the Russian republic of Udmurtia. |
| moget | | 25/07/2005 0:41:45 |
| This robot is used to build the database for the search service operated by goo |
| MojeekBot | | 31/10/2011 13:54:09 |
|
| monkia.com.tw | | 2/05/2006 23:40:26 |
|
| Monster | | 25/07/2005 0:46:52 |
| The Monster has two parts - Web searcher and Web analyzer. Searcher is intended to perform the list of WWW sites of desired domain (for example it can perform list of all WWW sites of mit.edu, com, org, etc... domain) In the User-agent field $TYPE is set to 'Mapper' for Web searcher and 'StAlone' for Web analyzer. |
| Motor | | 25/07/2005 0:48:09 |
| The Motor robot is used to build the database for the www.webindex.de search service operated by CyberCon. The robot is under development - it runs in random intervals and visits site in a priority driven order (.de/.ch/.at first, root and robots.txt first) |
| mozDex | | 18/04/2004 20:13:43 |
|
| MQbot | | 13/09/2006 1:25:52 |
|
| MSNBot | | 8/02/2004 16:19:40 |
|
| MSNBot Media | | 13/06/2006 0:06:56 |
|
| msnbot-Products | | 13/08/2016 9:23:13 |
|
| MSNPTC | | 8/02/2015 10:37:10 |
| Microsoft Search Robot |
| multicrawler | | 23/02/2009 0:53:03 |
| We are running MultiCrawler as part of SWSE, the Semantic Web Search Engine. |
| Muscat EuroFerret | | 10/02/2004 1:32:10 |
| Your source for the most popular Euroferret info! |
| NationalDirectory | | 8/02/2004 16:26:46 |
|
| NaverBot | | 8/02/2004 16:29:30 |
|
| NCSA | | 8/02/2004 16:22:33 |
|
| NEC-MeshExplorer | | 24/07/2005 23:04:16 |
The NEC-MeshExplorer robot is used to build database for the NETPLAZA search service operated by NEC Corporation. The robot searches URLs around sites in japan(JP domain). The robot runs every day, and visits sites in a random order.
Prototype version of this robot was developed in C&C Research Laboratories, NEC Corporation. Current robot (Version 1.0) is based on the prototype and has more functions. |
| Neevabot | | 6/05/2021 9:18:57 |
|
| NerdyBot | | 12/10/2015 16:44:53 |
NerdyBot is a web crawler used by NerdyData
Our search engine is different from search engines you've used before. We've visited over 140 million homepages and collected terabytes of HTML, Javascript, and CSS code. We allow users to search the full source code of web pages in our index, not just the plaintext.
NerdyBot runs on a cluster of several hundred servers, which is why you may see our web crawler access your site from many different IP addresses. |
| NetNose | | 8/02/2004 16:30:42 |
|
| NetResearchServer | | 8/02/2004 16:31:37 |
NRS crawls pages all over the world in order to build full-text
search indexes and/or to compile lists of search engine forms. |
| NetScoop | | 25/07/2005 1:01:18 |
The NetScoop robot is used to build the database for the NetScoop search engine.
The robot has been used in the research project at the Faculty of Engineering, Tokushima University, Japan., since Dec. 1996. |
| NetSprint | | 28/01/2007 22:42:43 |
| fell for bad bot trap |
| NextGenSearchBot | | 25/07/2005 3:01:07 |
| Zoom Information Inc. - formerly Eliyon Technologies, Inc. - remains focused on delivering people information solutions that are at the forefront of technology innovation and that meet our customers' needs. ZoomInfo is a unique summarization search engine that finds, understands, extracts and summarizes information about people on the Web. |
| Northern Light Gulliver | | 10/02/2004 1:24:30 |
| Northern Light, the busy little search engine company in Cambridge, provides search and content integration solutions for enterprises and individuals. Established in 1996, and utilizing the original award-winning Northern Light search technology, Northern Light's products include the brand new Northern Light® Enterprise Search Engine, SinglePoint™ Custom Market Research Portals, as well as technology licensing and custom enterprise search services. |
