Magus Bot
Web content analysis and data extraction crawler bot
About this crawler
Magus Bot is a web crawler identified by the regular-expression pattern Magus Bot in the User-Agent request header. It is categorised as monitoring. Use the regex above to detect, log, allow, or block Magus Bot traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- Magus Bot
- Pattern
Magus Bot- Tags
- monitoring
- Reference
- https://knownagents.com/agents/magus-bot
- Added
- 2026/04/26
- Instances
- 1 known sample(s)
Sample User-Agent strings
Magus Bot 1.0
Block this crawler
robots.txt — disallow Magus Bot:
User-agent: Magus Bot
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Magus Bot [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Magus Bot") {
return 403;
}
← back to all crawlers