Expanse
Palo Alto Networks Expanse bot for internet asset discovery
About this crawler
Expanse is a web crawler identified by the regular-expression pattern Expanse in the User-Agent request header. It is categorised as scanner. Use the regex above to detect, log, allow, or block Expanse traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- Expanse
- Pattern
Expanse- Tags
- scanner
- Reference
- https://www.paloaltonetworks.com/cortex/cortex-xpanse
- Added
- 2024/02/01
- Instances
- 1 known sample(s)
Sample User-Agent strings
Expanse, a Palo Alto Networks company, searches across the global IPv4 space multiple times per day to identify customers' presences on the Internet. If you would like to be excluded from our scans, please send IP addresses/domains to: [email protected]
Block this crawler
robots.txt — disallow Expanse:
User-agent: Expanse
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Expanse [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Expanse") {
return 403;
}
← back to all crawlers