Data Scnapshots dumb

166 views
Skip to first unread message

Michael Renz

unread,
Apr 26, 2020, 3:11:29 PM4/26/20
to build-kiva
Hi,
-> "[{"id":"If the error message is unclear","name":" enable logging using -o log_level=DEBUG and see the log to find out the cause. Contact support for further help."}]"

Seems there are issues with the Data Snapshot.

mfab

unread,
Apr 27, 2020, 2:54:46 PM4/27/20
to build-kiva
Hello! 

Thank you for your interest in working with Kiva data.  I just downloaded the csv snapshot and if you scroll, down past the error the Kiva loan data should be available up to around Feb 2019. 

Hope this helps!

mfab

unread,
Apr 27, 2020, 3:01:27 PM4/27/20
to build-kiva
We've done a lot of backend migrations and updates to the backend. We're hoping to have the snapshot updating again when the team has bandwidth. 

mfab

unread,
Apr 30, 2020, 1:10:23 PM4/30/20
to build-kiva
Hello Michael, 

The data snapshot has been updated. 

Hope this helps!

On Sunday, April 26, 2020 at 12:11:29 PM UTC-7, Michael Renz wrote:

Michael Renz

unread,
May 1, 2020, 6:38:01 AM5/1/20
to build-kiva
The Data Snapshot is still not working.

Kevin O'Brien

unread,
May 1, 2020, 12:42:23 PM5/1/20
to build...@googlegroups.com
Michael,

Your browser may have cached the file.

Try adding a param to bust the cache and get the latest file, e.g. 
http://s3.kiva.org/snapshots/kiva_ds_csv.zip?random=10

--
You received this message because you are subscribed to the Google Groups "build-kiva" group.
To unsubscribe from this group and stop receiving emails from it, send an email to build-kiva+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/build-kiva/18726e1b-3a4f-4bf9-b930-81f92249801e%40googlegroups.com.

Michael Renz

unread,
May 2, 2020, 2:42:50 PM5/2/20
to build-kiva
This solved the problem! Thanks. Now the CSV is 3.4GB big. Is there any way to get a smaller amount of Data as Snapshot?
Or any recommendation how to open it on a Mac. I tried several ways, but it did not work out....


On Friday, May 1, 2020 at 6:42:23 PM UTC+2, Mr. Chilly wrote:
Michael,

Your browser may have cached the file.

Try adding a param to bust the cache and get the latest file, e.g. 
http://s3.kiva.org/snapshots/kiva_ds_csv.zip?random=10

On Fri, May 1, 2020 at 3:38 AM Michael Renz <imthemichael...@gmail.com> wrote:
The Data Snapshot is still not working.

On Thursday, April 30, 2020 at 7:10:23 PM UTC+2, mfab wrote:
Hello Michael, 

The data snapshot has been updated. 

Hope this helps!

On Sunday, April 26, 2020 at 12:11:29 PM UTC-7, Michael Renz wrote:
Hi,
-> "[{"id":"If the error message is unclear","name":" enable logging using -o log_level=DEBUG and see the log to find out the cause. Contact support for further help."}]"

Seems there are issues with the Data Snapshot.

--
You received this message because you are subscribed to the Google Groups "build-kiva" group.
To unsubscribe from this group and stop receiving emails from it, send an email to build...@googlegroups.com.

Kevin O'Brien

unread,
May 2, 2020, 2:56:05 PM5/2/20
to build...@googlegroups.com
The size is a challenge for sure.

If you are comfortable with using the Terminal, try these steps out: https://eikhart.com/blog/autosplit-csv

CSV is fairly straight-forward to split up with command line tools and then as you get to know the data more you can play around with the ways to split it up.

To unsubscribe from this group and stop receiving emails from it, send an email to build-kiva+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/build-kiva/d9e9ee18-405c-485e-86d6-d555d13174a5%40googlegroups.com.

mfab

unread,
May 2, 2020, 3:12:13 PM5/2/20
to build-kiva
The snapshot usually blows out excel. But I've had luck opening it with a text editor like Sublime on a 2015 Mac. 

Michael Renz

unread,
May 3, 2020, 4:56:58 AM5/3/20
to build-kiva
This worked out well! Thanks
Reply all
Reply to author
Forward
0 new messages