Home
User Agents
New Agents
List All
My User Agent
Add New
User-Agents Database
Edit User Agent: stat
Name:
robots.txt:
N/A
Yes
No
DataMiningCommercial
DataMiningPublic
DownloadManager
EmailHarvesting
GuestbookSpamming
HackTool
ImageDownload
IndexingTool
Monitoring
OfflineBrowser
OtherBad
Trademark
ValidationTool
LinkChecking
Browser
MediaPlayer
Proxy
Adware
BrowserExtension
Spyware
Editing
Device
NewsFeed
SearchEngine
FilteringSoftware
SoftwareComponent
Translation
SEO
MailClient
AI
Key:
META tags:
N/A
Yes
No
URL:
User Agents (separate each entry with a CRLF):
stat statcrawler@gmail.com
IP Ranges (separate each entry with a CRLF):
66.92.186.*
Information:
Experimental search engine stat is an experimental crawler for a next generation search engine like service, which would try to be webmaster friendly. It's interesting that it only got noticed by now after it has crawled tens of millions of pages. I haven't seen any complains (aside from a couple of curious inquiries) yet regarding it's behavior. It adheres to the robots.txt instructions. The current minimum page fetch interval for a site is 30 seconds (there is no scheduled delay between the fetch of robots.txt and the first page.) I suspect most webmasters won't mind as there are zero complaints so far. The intention is to create a service that is mutually beneficial to the sites crawled and the service provider. If you think it's misbehaving on your site, send a note to statcrawler@gmail.com and it'll be dealt with.
FromHeader
User Agents - Search
Enter keyword or user agent:
AQTRON
i
X
Serious about Security
Copyright © 2025 AQTRONiX. All rights reserved.
