Bibliotheque Nacional de France Crawler
French National Library web archiving and preservation bot
About this crawler
Bibliotheque Nacional de France Crawler is a web crawler identified by the regular-expression pattern Bibliotheque Nacional de France Crawler in the User-Agent request header. It is categorised as archiver. Use the regex above to detect, log, allow, or block Bibliotheque Nacional de France Crawler traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- Bibliotheque Nacional de France Crawler
- Pattern
Bibliotheque Nacional de France Crawler- Tags
- archiver
- Reference
- https://www.bnf.fr/en/web-legal-deposit
- Added
- 2026/04/26
- Instances
- 1 known sample(s)
Sample User-Agent strings
Bibliotheque Nacional de France Crawler
Block this crawler
robots.txt — disallow Bibliotheque Nacional de France Crawler:
User-agent: Bibliotheque Nacional de France Crawler
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Bibliotheque Nacional de France Crawler [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Bibliotheque Nacional de France Crawler") {
return 403;
}
← back to all crawlers