All 2026
path: /robots.txt ×

Human visitors: 108

0 100 200 300

Scrapers: 715

0 100 200 300

Paths

🔍
/robots.txt
122 100%

Referrers

🔍
clojurians-log.clojureverse.org
18 64%
🔍
google.com
9 32%
🔍
google.org
1 4%

Browsers

🔍
Chrome
57 54%
🔍
Safari
22 21%
🔍
Firefox
11 10%
🔍
Edg
9 8%
🔍
UBrowser
2 1.9%
🔍
QQBrowser
1 0.9%
🔍
OPR
1 0.9%
🔍
BingSapphire
1 0.9%
🔍
EdgA
1 0.9%
🔍
Claude-User
1 0.9%

Scrapers

🔍
ClaudeBot
255 36%
🔍
YandexBot
146 20%
🔍
facebookexternalhit
123 17%
🔍
SemrushBot
39 5%
🔍
MJ12bot
34 5%
🔍
Applebot
30 4%
🔍
Go-http-client
15 2%
🔍
Googlebot
15 2%
🔍
OAI-SearchBot
12 1.7%
🔍
ClueWeb-Crawler
7 1.0%
Others
39 5%