|
|
|
|
User-Agents Database |
User Agent Details of Excite ArchitextSpider
Name: | Excite ArchitextSpider |
URL: | http://www.excite.com/ |
User Agent Key: | ArchitextSpider |
User Agents: | ArchitextSpider
|
IP Ranges: | |
Adheres robots.txt: | Yes |
Adheres META tag: | No |
Type(s): |
SearchEngine
|
Verified: | Yes | Info: | Its purpose is to generate a Resource Discovery database, and to generate statistics. The ArchitextSpider collects information for the Excite and WebCrawler search engines. | Date Added: | 10/02/2004 1:19:52 | | |
User Agents - Search
|
|