Index of /anubis/data/crawlers

[ICO]NameLast modifiedSizeDescription

[PARENTDIR]Parent Directory  -  
[   ]internet-archive.yaml2026-10-09 04:33 148  
[   ]yandexbot.yaml2026-10-09 04:33 184  
[   ]qwantbot.yaml2026-10-09 04:33 200  
[   ]mojeekbot.yaml2026-10-09 04:33 210  
[   ]kagibot.yaml2026-10-09 04:33 240  
[   ]xai.yaml2026-10-09 04:33 243  
[   ]commoncrawl.yaml2026-10-09 04:33 271  
[   ]marginalia.yaml2026-10-09 04:33 273  
[   ]ai-training.yaml2026-10-09 04:33 292  
[   ]arquivo-pt.yaml2026-10-09 04:33 315  
[   ]ai-search.yaml2026-10-09 04:33 355  
[   ]wikimedia-citoid.yaml2026-10-09 04:33 385  
[   ]openai-searchbot.yaml2026-10-09 04:33 435  
[   ]openai-gptbot.yaml2026-10-09 04:33 465  
[   ]perplexitybot.yaml2026-10-09 04:33 495  
[   ]applebot.yaml2026-10-09 04:33 518  
[   ]_allow-good.yaml2026-10-09 04:33 547  
[   ]bingbot.yaml2026-10-09 04:33 862  
[   ]tencent-cloud.yaml2026-10-09 04:33 3.4K 
[   ]googlebot.yaml2026-10-09 04:33 7.9K 
[   ]duckduckbot.yaml2026-10-09 04:33 11K 
[   ]huawei-cloud.yaml2026-10-09 04:33 14K 
[   ]alibaba-cloud.yaml2026-10-09 04:33 26K 

Apache/2.4.71 (Debian) Server at doc.fruit.je Port 443