Home
User Agents
New Agents
List All
My User Agent
Add New
User-Agents Database
Edit User Agent: JCrawler
Name:
robots.txt:
N/A
Yes
No
DataMiningCommercial
DataMiningPublic
DownloadManager
EmailHarvesting
GuestbookSpamming
HackTool
ImageDownload
IndexingTool
Monitoring
OfflineBrowser
OtherBad
Trademark
ValidationTool
LinkChecking
Browser
MediaPlayer
Proxy
Adware
BrowserExtension
Spyware
Editing
Device
NewsFeed
SearchEngine
FilteringSoftware
SoftwareComponent
Translation
SEO
MailClient
AI
Key:
META tags:
N/A
Yes
No
URL:
User Agents (separate each entry with a CRLF):
JCrawler/0.2
IP Ranges (separate each entry with a CRLF):
Information:
JCrawler is currently used to build the Vietnam topic specific WWW index for VietGATE . It schedules visits randomly, but will not visit a site more than once every two minutes. It uses a subject matter relevance pruning algorithm to determine what pages to crawl and index and will not generally index pages with no Vietnam related content. Uses Unicode internally, and detects and converts several different Vietnamese character encodings.
FromHeader
User Agents - Search
Enter keyword or user agent:
AQTRON
i
X
Serious about Security
Copyright © 2025 AQTRONiX. All rights reserved.
