Upload data from PC and converting log file to KML for view on PC

[Gary]

This is my first time ever writing to a board, so be patient, I have seen rude comments on other boards before.

I have just finished building my bgeigie nano and would like to start contributing log files. However, it seems that having a Mac is essential and I do not have a Mac, only PC with windows 7 and 8. Also got an Android phone.

Anyway, I am not into programming but I do tinker a bit with computers so I can handle a few things given instructions or being pointed in the right direction.  I have Googled, looked at Safecast and Github pages but not been able to find the help I need.

So, could anyone tell me how to upload to Safecast, or where I can find the information ? (if it has to do with the API I think some serious help unfortunately.

Also, I would like to look at the some of my log files in Google Maps/Earth at home without having to upload them first. Maybe I can put together a Matlab script that reads the file and convert it to a KML file. But surely people would have had an interest in looking at their data asap, or is again just me having a PC that have this problem. Hopefully someone will know about such a program and can direct me.

I just want to start contributing with some data from Australia and not just having a working nano that just collects dust at home.

Cheers

Gary

[Kalin KOZHUHAROV (Safecast)]

Hello Gary,

On Wed, Oct 29, 2014 at 6:13 PM, Gary <gry...@gmail.com> wrote:
> I have just finished building my bgeigie nano and would like to start
> contributing log files.
>

Congratulations!

> However, it seems that having a Mac is essential and I do not have a Mac,
> only PC with windows 7 and 8. Also got an Android phone.
>

I really don't understand why you need a Mac? While some people in Safecast
do use Macs, some do Windows, few (/me included) are linux-only ;-)
There is no direct requirements for any platform. You should be able
to contribute
data even with a recent phone/tablet (iDevice or Android or may be
even Surface).
All you need is a web browser and a way to get the log file from your SD card
to the browser (well and Internet as well).

> Anyway, I am not into programming but I do tinker a bit with computers so I
> can handle a few things given instructions or being pointed in the right
> direction. I have Googled, looked at Safecast and Github pages but not been
> able to find the help I need.
>
> So, could anyone tell me how to upload to Safecast, or where I can find the
> information ? (if it has to do with the API I think some serious help
> unfortunately.
>

Yes, that is what our API site is for. But it does not require any programming,
or understanding of programming (API = Application Programming
Interface just means that you don't need to use the website, if you
can program and send the data directly).

Quick howto:
1. Register free account: https://api.safecast.org/en-US/users/sign_up
2. Sign in: https://api.safecast.org/en-US/users/sign_in
3. Upload a log: https://api.safecast.org/en-US/bgeigie_imports/new
Add metadata and submit it for approval.
Please make the difference between "submit a measurement", "upload a
log" and "submit log for approval".
Someone will make sure that you entered "proper" metadata (see other
drives, or ask) and soon your data will be visible on
http://safecast.org/tilemap/

Please try and let us know if you hit a problem.

> Also, I would like to look at the some of my log files in Google Maps/Earth
> at home without having to upload them first. Maybe I can put together a
> Matlab script that reads the file and convert it to a KML file. But surely
> people would have had an interest in looking at their data asap, or is again
> just me having a PC that have this problem. Hopefully someone will know
> about such a program and can direct me.
>

Well, if you can do that - go ahead. I cannot vote for Matlab, but hey
if that is your choice, stick with it.

We have a running service that will do that for you, just attach the
log file to a mail addressed to dat...@safecast.org and wait some
minutes.
In the subject line of your email, type in these tags: [en] for
English mode, [pdf] for PDF report, [kml] for KML report, [gpx] for
GPX report, [csv] for CSV report, [summary] for a summary report of
all logs, [split] for splitting report by 5km x 5km subreports,
[peak60] for rendering peak from 1 minute CPM data and [peak5] for
rendering peak from 5 seconds CPM data (default is [jp][pdf][kml]), so
you are better off with [en][pdf][kml] .

If you prefer, you can try running it on your machine or your server,
code is here: https://github.com/Safecast/Databot

> I just want to start contributing with some data from Australia and not just
> having a working nano that just collects dust at home.
>

Are you by chance in Sydney? I'll be visiting Nov 14-20.

Cheers,
Kalin.

[Jan Helebrant]

Hi,
I know this thread is a little bit old but maybe it could be also useful for other people. First it is not much complicated to convert bGegie LOG file to standard CSV using for example LibreOffice Calc - I have spreadsheet template where I simply add the data and it creates me converted data in other sheet - for example it recalculates the coordinates to standard decimal format etc.

Currently we also have an command-line (windows and linux support) utility doing this directly. I simply load the CSV file produced by this utility into QGIS ( freely available on http://qgis.org/en/site/ ) and add any background map (online Google, OpenStreetmap or Bing via Opelayers plugin) or offline like geotiff etc. I already have predefined QGIS styles which I simply apply and can check my data before uploading to Safecast server.

hope this helps

Jan

PS: it is also possible that Google Earth could load the CSV directly too :-)

[Kalin KOZHUHAROV (Safecast)]

On Mon, Jul 13, 2015 at 3:32 AM, Jan Helebrant <jan.he...@gmail.com> wrote:
> I know this thread is a little bit old but maybe it could be also useful for
> other people. First it is not much complicated to convert bGegie LOG file to
> standard CSV using for example LibreOffice Calc - I have spreadsheet
> template where I simply add the data and it creates me converted data in
> other sheet - for example it recalculates the coordinates to standard
> decimal format etc.
>

Link?

> Currently we also have an command-line (windows and linux support) utility
> doing this directly. I simply load the CSV file produced by this utility
> into QGIS ( freely available on http://qgis.org/en/site/ ) and add any
> background map (online Google, OpenStreetmap or Bing via Opelayers plugin)
> or offline like geotiff etc. I already have predefined QGIS styles which I
> simply apply and can check my data before uploading to Safecast server.
>

Where was that?

I'll have to upload a basemap (on-line) QGIS file (project) one of
these days, it has all the tile layers currently available fetched
from the server, so you can plot your data on top.

Kalin.

[Jan Helebrant]

Hi Kalin,
first, regarding the spreadsheet file - you can get it here:
https://docs.google.com/spreadsheets/d/1mkkKLLecVOWRqyiDL3m4waAEdw_YdZW_MzRvQ6cPCPE/edit?usp=sharing

In my case I only have to change decimal separator in the imported data to make it work but this can depend on locale settings.

Second, about the QGIS - in fact I have two project templates - first one uses online background tilemap using Openlayers (depending on my needs I use Google Streets or Hybrid layer) and also some symbology styles for the point layers. My default style is adjusted to check common data so I have graduated colors for dose rates 0-300 or 400 nanoSieverts/hour (just to see the even smaller changes in data) but I sometimes have to adjust it on demand.

I also have other QGIS project for offline use. This has Openstreetmap data for only my country in Spatialite format and with style similar to Google Streets:
http://anitagraser.com/2014/05/31/a-guide-to-googlemaps-like-maps-with-osm-in-qgis/
I also have some map templates but these are made especially for our institute so I am not sure whether they could also be useful for other people (you can define your own really easily).

regards

Jan

[Kalin KOZHUHAROV (Safecast)]

Hello Jan,

Pieter just send me your blog
http://juhele.blogspot.jp/2016/07/safecast-bgegie-nano-qgis-plugin-and.html
Good work!

Will this plugin be opensource? Any repository/code link?

I have a few Safecast related things that I was planning to package as
a QGIS and OSMAnd plugins, but never did.

If the code is open, I can try to add in your plugin instead. Have you
played with Android and OSMAnd?

Kalin.