Update on the documentation Wiki

4 views
Skip to first unread message

Jim Breen

unread,
Aug 16, 2025, 3:33:26 AMAug 16
to edict-...@googlegroups.com
The documentation Wiki at https://www.edrdg.org/wiki/index.php/ has been permanently closed. I tried reopening it a few times and the scrapers returned in hordes. The problem is that the way a MediaWiki site works is to serve everything out of database records. The scrapers try to explore every known rabbit-hole in the structure, so there are masses of database accesses (and processes) which clog up the server.

Anyone now accessing a Wiki URL goes to a single (non-database) page, which contains:
- a link to the archive.org copy of the full Wiki 
- links to local copies of most of the documentation pages, which I downloaded before the closure 

There are still 2-3k scraping attempts a day, down from recent peaks of 80-100k. For some reason there was a surge two days ago, with 75k attempts. They came from over 70k different IP addresses!

When I get the chance I'll get the documentation reorganised.

Jim


Reply all
Reply to author
Forward
0 new messages