Known Agent
Known Agents test and development bot
About this crawler
Known Agent is a web crawler identified by the regular-expression pattern Known Agent in the User-Agent request header. It is categorised as monitoring. Use the regex above to detect, log, allow, or block Known Agent traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.13%
Technical details
- Name
- Known Agent
- Pattern
Known Agent- Tags
- monitoring
- Reference
- https://knownagents.com/
- Added
- 2026/04/26
- Instances
- 2 known sample(s)
Sample User-Agent strings
Mozilla/5.0 (compatible; Known Agent/1.0; +https://knownagents.com)
Mozilla/5.0 (compatible; Known Agents Browser/1.0; +https://knownagents.com)
Block this crawler
robots.txt — disallow Known Agent:
User-agent: Known Agent
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Known Agent [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Known Agent") {
return 403;
}
← back to all crawlers