Index of /anubis/data/crawlers

[ICO]NameLast modifiedSizeDescription

[PARENTDIR]Parent Directory  -  
[   ]yandexbot.yaml2026-08-08 19:17 184  
[   ]xai.yaml2026-08-08 19:17 243  
[   ]wikimedia-citoid.yaml2026-08-08 19:17 385  
[   ]tencent-cloud.yaml2026-08-08 19:17 3.4K 
[   ]qwantbot.yaml2026-08-08 19:17 200  
[   ]perplexitybot.yaml2026-08-08 19:17 495  
[   ]openai-searchbot.yaml2026-08-08 19:17 435  
[   ]openai-gptbot.yaml2026-08-08 19:17 465  
[   ]mojeekbot.yaml2026-08-08 19:17 210  
[   ]marginalia.yaml2026-08-08 19:17 273  
[   ]kagibot.yaml2026-08-08 19:17 240  
[   ]internet-archive.yaml2026-08-08 19:17 148  
[   ]huawei-cloud.yaml2026-08-08 19:17 14K 
[   ]googlebot.yaml2026-08-08 19:17 7.9K 
[   ]duckduckbot.yaml2026-08-08 19:17 11K 
[   ]commoncrawl.yaml2026-08-08 19:17 271  
[   ]bingbot.yaml2026-08-08 19:17 862  
[   ]arquivo-pt.yaml2026-08-08 19:17 315  
[   ]applebot.yaml2026-08-08 19:17 518  
[   ]alibaba-cloud.yaml2026-08-08 19:17 26K 
[   ]ai-training.yaml2026-08-08 19:17 292  
[   ]ai-search.yaml2026-08-08 19:17 355  
[   ]_allow-good.yaml2026-08-08 19:17 547  

Apache/2.4.68 (Debian) Server at doc.fruit.je Port 443