All 2026
path: /robots.txt ×

Human visitors: 97

0 100 200 300

Scrapers: 672

0 100 200 300

Paths

🔍
/robots.txt
109 100%

Referrers

🔍
clojurians-log.clojureverse.org
16 64%
🔍
google.com
8 32%
🔍
google.org
1 4%

Browsers

🔍
Chrome
51 54%
🔍
Safari
20 21%
🔍
Firefox
10 11%
🔍
Edg
8 8%
🔍
QQBrowser
1 1.1%
🔍
BingSapphire
1 1.1%
🔍
EdgA
1 1.1%
🔍
OPR
1 1.1%
🔍
Claude-User
1 1.1%
🔍
UBrowser
1 1.1%

Scrapers

🔍
ClaudeBot
252 38%
🔍
YandexBot
138 21%
🔍
facebookexternalhit
105 16%
🔍
SemrushBot
38 6%
🔍
MJ12bot
29 4%
🔍
Applebot
28 4%
🔍
Googlebot
14 2%
🔍
Go-http-client
14 2%
🔍
OAI-SearchBot
11 1.6%
🔍
ClueWeb-Crawler
7 1.0%
Others
36 5%