bigsur.ai

ai-crawler bigsur\.ai

Big Sur AI's web agent crawler

About this crawler

bigsur.ai is a web crawler identified by the regular-expression pattern bigsur\.ai in the User-Agent request header. It is categorised as ai-crawler. Use the regex above to detect, log, allow, or block bigsur.ai traffic in your web server, CDN edge rules, or robots.txt.

Block-rate · top 25k sites

0.72%
latest snapshot
2026-06-04
matched key: bigsur.ai
2026-05-012026-06-040.88%

Technical details

Name
bigsur.ai
Pattern
bigsur\.ai
Tags
ai-crawler
Reference
https://bigsur.ai/
Added
2026/04/26
Instances
1 known sample(s)

Sample User-Agent strings

bigsur.ai

Block this crawler

robots.txt — disallow bigsur.ai:

User-agent: bigsur.ai Disallow: /

Apache .htaccess — return 403:

RewriteEngine On RewriteCond %{HTTP_USER_AGENT} bigsur\.ai [NC] RewriteRule .* - [F,L]

Nginx — return 403 inside a server block:

if ($http_user_agent ~* "bigsur\\.ai") { return 403; }
← back to all crawlers