ExB Language Crawler
ExB language processing crawler
About this crawler
ExB Language Crawler is a web crawler identified by the regular-expression pattern ExB Language Crawler in the User-Agent request header. It is categorised as academic. Use the regex above to detect, log, allow, or block ExB Language Crawler traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.26%
Technical details
- Name
- ExB Language Crawler
- Pattern
ExB Language Crawler- Tags
- academic
- Reference
- http://www.exb.de/crawler
- Added
- 2026/05/09
- Instances
- 3 known sample(s)
Sample User-Agent strings
ExB Language Crawler 2.1.1 (+http://www.exb.de/crawler)
ExB Language Crawler 2.1.2 (+http://www.exb.de/crawler)
ExB Language Crawler 2.1.5 (+http://www.exb.de/crawler)
Block this crawler
robots.txt — disallow ExB Language Crawler:
User-agent: ExB Language Crawler
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ExB Language Crawler [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "ExB Language Crawler") {
return 403;
}
← back to all crawlers