Home
User Agents
New Agents
List All
My User Agent
Add New
User-Agents Database
Edit User Agent: Shim-Crawler
Name:
robots.txt:
N/A
Yes
No
DataMiningCommercial
DataMiningPublic
DownloadManager
EmailHarvesting
GuestbookSpamming
HackTool
ImageDownload
IndexingTool
Monitoring
OfflineBrowser
OtherBad
Trademark
ValidationTool
LinkChecking
Browser
MediaPlayer
Proxy
Adware
BrowserExtension
Spyware
Editing
Device
NewsFeed
SearchEngine
FilteringSoftware
SoftwareComponent
Translation
SEO
MailClient
AI
Key:
META tags:
N/A
Yes
No
URL:
User Agents (separate each entry with a CRLF):
Shim-Crawler(Mozilla-compatible; http://www.logos.ic.i.u-tokyo.ac.jp/crawler/; crawl@logos.ic.i.u-tokyo.ac.jp)
IP Ranges (separate each entry with a CRLF):
Information:
Shim-crawler was written by Shim Wonbo of Chikayama-Taura laboratory.The main goal behind writing the crawler is to collect web pages for researches related to web-search and data mining. Recently, we are planning to use it for crawling weblogs too.The Crawler is used by the members of Chikayama-Taura Laboratory to crawl web-pages only for the research purposes.Our crawling policy distinctly respects the general crawling norm.Though we duely understand the concern of the webmasters, we would like to assure that our crawler is only crawling pages for performing researches and not for any business use.Please have a glance at our crawling policy for better understanding.We sincerely appriciate your co-operation and support.
FromHeader
User Agents - Search
Enter keyword or user agent:
AQTRON
i
X
Serious about Security
Copyright © 2025 AQTRONiX. All rights reserved.
