CISPA Webcrawler
CISPA web crawler for vulnerability
About this crawler
CISPA Webcrawler is a web crawler identified by the regular-expression pattern CISPA Webcrawler in the User-Agent request header. It is categorised as academic. Use the regex above to detect, log, allow, or block CISPA Webcrawler traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- CISPA Webcrawler
- Pattern
CISPA Webcrawler- Tags
- academic
- Reference
- https://vuln-notify-checker.cispa.saarland
- Added
- 2023/09/08
- Instances
- 1 known sample(s)
Sample User-Agent strings
CISPA Webcrawler (https://vuln-notify-checker.cispa.saarland)
Block this crawler
robots.txt — disallow CISPA Webcrawler:
User-agent: CISPA Webcrawler
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} CISPA Webcrawler [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "CISPA Webcrawler") {
return 403;
}
← back to all crawlers