All 2026
path: /robots.txt ×

Human visitors: 319

2026-08
0 100 200 300

Scrapers: 1,461

2026-08
0 100 200 300

Paths

🔍
/robots.txt
371 100%

Referrers

🔍
clojurians-log.clojureverse.org
48 73%
🔍
google.com
17 26%
🔍
google.org
1 1.5%

Browsers

🔍
Chrome
184 58%
🔍
Safari
64 20%
🔍
Firefox
36 11%
🔍
Edg
20 6%
🔍
UBrowser
3 1.0%
🔍
SitemapReader
1 0.3%
🔍
VivoBrowser
1 0.3%
🔍
BingSapphire
1 0.3%
🔍
Claude-User
1 0.3%
🔍
EdgA
1 0.3%
Others
3 1.0%

Scrapers

🔍
ClaudeBot
339 23%
🔍
YandexBot
271 19%
🔍
facebookexternalhit
245 17%
🔍
MJ12bot
110 8%
🔍
Applebot
79 5%
🔍
YouBot
57 4%
🔍
Reflectionbot
57 4%
🔍
SemrushBot
39 3%
🔍
Googlebot
32 2%
🔍
AhrefsBot
30 2%
Others
201 14%