MU

MistralAI-User

ai-fetcher MistralAI-User

Mistral AI web crawler bot for content indexing

About this crawler

MistralAI-User is a web crawler identified by the regular-expression pattern MistralAI-User in the User-Agent request header. It is categorised as ai-fetcher. Use the regex above to detect, log, allow, or block MistralAI-User traffic in your web server, CDN edge rules, or robots.txt.

Block-rate · top 25k sites

1.3%
latest snapshot
2026-06-04
matched key: MistralAI-User
2026-05-012026-06-041.7%

Technical details

Name
MistralAI-User
Pattern
MistralAI-User
Tags
ai-fetcher
Added
2026/04/07
rDNS suffixes
.mistral.ai
Instances
1 known sample(s)

rDNS verification (FCrDNS)

Verify a request is genuinely MistralAI-User with forward-confirmed reverse DNS: the client IP's PTR record must end in one of the suffixes below and a forward A/AAAA lookup of that hostname must return the same IP. UA strings alone are spoofable; FCrDNS is not.

Sample User-Agent strings

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)

Block this crawler

robots.txt — disallow MistralAI-User:

User-agent: MistralAI-User Disallow: /

Apache .htaccess — return 403:

RewriteEngine On RewriteCond %{HTTP_USER_AGENT} MistralAI-User [NC] RewriteRule .* - [F,L]

Nginx — return 403 inside a server block:

if ($http_user_agent ~* "MistralAI-User") { return 403; }
← back to all crawlers