Offline Explorer
Website downloader tool for offline archival and content analysis
About this crawler
Offline Explorer is a web crawler identified by the regular-expression pattern Offline Explorer in the User-Agent request header. It is categorised as archiver. Use the regex above to detect, log, allow, or block Offline Explorer traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
1.7%
Technical details
- Name
- Offline Explorer
- Pattern
Offline Explorer- Tags
- archiver
- Reference
- https://datadome.co/bots/offline-explorer/
- Added
- 2026/04/17
- Instances
- 1 known sample(s)
Sample User-Agent strings
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Offline Explorer; MSIECrawler)
Block this crawler
robots.txt — disallow Offline Explorer:
User-agent: Offline Explorer
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Offline Explorer [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Offline Explorer") {
return 403;
}
← back to all crawlers