Gulper Web Bot

academic Gulper Web Bot

Academic web crawler collecting data for research and link analysis

About this crawler

Gulper Web Bot is a web crawler identified by the regular-expression pattern Gulper Web Bot in the User-Agent request header. It is categorised as academic. Use the regex above to detect, log, allow, or block Gulper Web Bot traffic in your web server, CDN edge rules, or robots.txt.

Block-rate · top 25k sites

0.065%
latest snapshot
2026-06-04
matched key: Gulper Web Bot
2026-05-012026-06-040.11%

Technical details

Name
Gulper Web Bot
Pattern
Gulper Web Bot
Tags
academic
Reference
https://datadome.co/bots/gulperbot/
Added
2026/04/17
Instances
1 known sample(s)

Sample User-Agent strings

Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)

Block this crawler

robots.txt — disallow Gulper Web Bot:

User-agent: Gulper Web Bot Disallow: /

Apache .htaccess — return 403:

RewriteEngine On RewriteCond %{HTTP_USER_AGENT} Gulper Web Bot [NC] RewriteRule .* - [F,L]

Nginx — return 403 inside a server block:

if ($http_user_agent ~* "Gulper Web Bot") { return 403; }
← back to all crawlers