MB

Mail.RU_Bot

search-engine Mail\.RU_Bot

Mail.RU search engine web crawler bot

About this crawler

Mail.RU_Bot is a web crawler identified by the regular-expression pattern Mail\.RU_Bot in the User-Agent request header. It is categorised as search-engine. Use the regex above to detect, log, allow, or block Mail.RU_Bot traffic in your web server, CDN edge rules, or robots.txt.

Block-rate · top 25k sites

0.39%
latest snapshot
2026-06-04
matched key: Mail.RU_Bot
2026-05-012026-06-040.55%

Technical details

Name
Mail.RU_Bot
Pattern
Mail\.RU_Bot
Tags
search-engine
Added
2011/04/27
rDNS suffixes
.mail.ru
Instances
4 known sample(s)

rDNS verification (FCrDNS)

Verify a request is genuinely Mail.RU_Bot with forward-confirmed reverse DNS: the client IP's PTR record must end in one of the suffixes below and a forward A/AAAA lookup of that hostname must return the same IP. UA strings alone are spoofable; FCrDNS is not.

Sample User-Agent strings

Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/
Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +http://go.mail.ru/help/robots)

Block this crawler

robots.txt — disallow Mail.RU_Bot:

User-agent: Mail.RU_Bot Disallow: /

Apache .htaccess — return 403:

RewriteEngine On RewriteCond %{HTTP_USER_AGENT} Mail\.RU_Bot [NC] RewriteRule .* - [F,L]

Nginx — return 403 inside a server block:

if ($http_user_agent ~* "Mail\\.RU_Bot") { return 403; }
← back to all crawlers