git

http-library git\/

Git version control CLI

About this crawler

git is a web crawler identified by the regular-expression pattern git\/ in the User-Agent request header. It is categorised as http-library. Use the regex above to detect, log, allow, or block git traffic in your web server, CDN edge rules, or robots.txt.

Block-rate · top 25k sites

0.061%
latest snapshot
2026-06-03
matched key: DigitalOceanGenAICrawler
2026-05-022026-06-030.11%

Technical details

Name
git
Pattern
git\/
Tags
http-library
Reference
https://git-scm.com/
Added
2026/05/09
Instances
1 known sample(s)

Sample User-Agent strings

git/2.1.4

Block this crawler

robots.txt — disallow git:

User-agent: git Disallow: /

Apache .htaccess — return 403:

RewriteEngine On RewriteCond %{HTTP_USER_AGENT} git\/ [NC] RewriteRule .* - [F,L]

Nginx — return 403 inside a server block:

if ($http_user_agent ~* "git\\/") { return 403; }
← back to all crawlers