IMSLP dump

[Luiz Augusto]

The new IMSLP dump that I've started on 6 January just finished few hours ago.

The XML dumping piece finished on 27 February.

The bad news:

* I got a corrupted XML dump:

$ grep "<title>" *.xml -c;grep "<page>" *.xml -c;grep "</page>" *.xml -c;grep "<revision>" *.xml -c;grep "</revision>" *.xml -c

463544

463544

463526

1418977

1418976

* I cannot run a new dump. In fact, I was only waiting for this dump finishes to take a new wikibreak on wikiteam tasks (busy both on Wikimedia and on real life; dumping IMSLP isn't only a resource consumer thing, but also needs lots of babysitting).

By the way, I'm 7zipping the generated files to upload into Internet Archive, since those includes 90% of valid XML revisions and 319925 media files.

[Luiz Augusto]

Upload finished: https://archive.org/details/wiki_imslp_org_20140106

Before this I've also uploaded more dumps still on opensource collection. As usual, you can found those searching for subject:wikiteam

[Emilio J. Rodríguez-Posada]

Thanks for this work Luiz. Big dumps are hard to generate. Don't worry about the corrupted parts, in case of being requered they can be trimed.

--
You received this message because you are subscribed to the Google Groups "wikiteam-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wikiteam-discu...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.