iso logs

[Andrew Iannaccone]

Are the logs still available on Iso's or CouncilRoom's server? I can't seem to find them. Would anyone else be willing to provide them to me?

I'm not planning any counterpart to Iso's various analyses, achievements, etc. But I would like to let people find old Iso games using my search interface.

Thanks,

Andrew

[Michael McCallister]

Hi Andrew,

If you're looking to download the log files in bulk, they are available in tar.bz2 files by game date. These files should be accessible to all at the following URL pattern:

curl --head https://s3.amazonaws.com/static.councilroom.mccllstr.com/scrape_data/YYYYMMDD.all.tar.bz2

The games go back to 2010-10-14. These are hosted on AWS, so you can hammer them as hard as you want (download in bulk, many parallel gets, etc.). I do pay a small amount for bytes transferred ($0.095 per GB), so please try to download them once and then save a copy.

That said, we should probably talk and see if there is any interest in working together. Max Gibiansky recently contributed some major updates to the CouncilRoom code base that have enabled it to parse the Goko logs. I've got the Goko logs from February to near present day loaded into the DB, and we're working on getting the rest of the processing pipeline updated to it can update all the stats. Thoughts?

Mike