new Grapherate library for live sensor data via Phant

[Jeffrey Warren]

After working with Mathew Lippincott on a quick live graphing system for particulate data, I caught up with Don Blair at LEAFFEST about adapting this system to display data from a Riffle, like how John Keefe (CC'ed) has been displaying stream water data for his class in West Virginia

After an intense planning session on Friday, I put together an initial release, which is not 100% awesome but has a lot of promise. We'd been calling the open source library "grapherate" so we're sticking with that for now:

https://github.com/jywarren/grapherate

The gist is, you can paste in a public key from data.sparkfun.com and it immediately generates a graph which updates every 10 seconds:

Try it (early alpha warning!) at: https://jywarren.github.io/grapherate/

We're adding more configuration options, better graph display, etc, as we go:

https://github.com/jywarren/grapherate/milestones/v0.1.0%20-%20barebones%20initial%20release

If anyone's interested in collaborating on this, please give a shout out! We're basically interested in easy, free, embeddable/shareable and consistent data display across DIY sensor projects. 

Grapherate is also designed to be included into other open source projects as a bower component. Open to pull requests, feature requests, etc!

Best,

Jeff

[joan schnabel/jeff falk]

Quick comment: having worked with every 20 second air quality and weather data I’d say having the data available is great, visualizing 20 second data graphically is overload.

jeff falk

On Oct 19, 2015, at 11:46 AM, Jeffrey Warren <je...@publiclab.org> wrote:

After working with Mathew Lippincott on a quick live graphing system for particulate data, I caught up with Don Blair at LEAFFEST about adapting this system to display data from a Riffle, like how John Keefe (CC'ed) has been displaying stream water data for his class in West Virginia

After an intense planning session on Friday, I put together an initial release, which is not 100% awesome but has a lot of promise. We'd been calling the open source library "grapherate" so we're sticking with that for now:

https://github.com/jywarren/grapherate

The gist is, you can paste in a public key from data.sparkfun.com and it immediately generates a graph which updates every 10 seconds:

<image.png>

Try it (early alpha warning!) at: https://jywarren.github.io/grapherate/

We're adding more configuration options, better graph display, etc, as we go:

https://github.com/jywarren/grapherate/milestones/v0.1.0%20-%20barebones%20initial%20release

If anyone's interested in collaborating on this, please give a shout out! We're basically interested in easy, free, embeddable/shareable and consistent data display across DIY sensor projects. 

Grapherate is also designed to be included into other open source projects as a bower component. Open to pull requests, feature requests, etc!

Best,

Jeff

<image.png>

--
Post to this group at plots-ai...@googlegroups.com
 
Public Lab mailing lists (http://publiclab.org/lists) are great for discussion, but to get attribution, open source your work, and make it easy for others to find and cite your contributions, please publish your work at http://publiclab.org
---
You received this message because you are subscribed to the Google Groups "plots-airquality" group.
To unsubscribe from this group and stop receiving emails from it, send an email to plots-airquali...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jeffrey Warren]

Thanks, Jeff! 

10 second is just the default; we're going to make it possible to set the interval; 

also, this is how often it fetches new data from Phant, not, how often the sensor itself records.

--Jeff

[James Moulding]

Hi,

Just spotted your conversation and thought I might be able to help! OpenSensors.io is releasing new embeddable widgets for real-time graphing of sensor data next week. You can embed these widgets into your website with a simple div-tag and enable you to visualise data-feeds flowing through any public OpenSensors data-feed through a choice of graphs or raw data payload values. These would be brilliant for visualising pollution data as you are attempting to do. Let me know if you're interested!

Also - If you're not familiar with OpenSensors, we're the messaging backend for IoT projects, including the Air Quality Egg V2, we also run a real-time public data exchange. We have lots of real-time datasets on earthquakes, air quality, transport etc, including individuals and communities publishing their sensor data to the exchange - anyone can search for, access and use and download this data at no cost via our APIs -only cost is for keeping data private.

We've just upgraded our APIs and built a sparkly new website and we're now ingesting over 6 million sensor messages a day, which isn't too bad for a tiny startup! Try out the site when you have the time!

All the best,

James Moulding
james.m...@opensensors.io

[Jeffrey Warren]

Hi, James - is your widget/graph system open source? If so, we would love to see if we could collaborate, or extend, or integrate, or otherwise try to share in the development, which is what we're hoping to do with Grapherate. We don't have a lot sunk into Grapherate just yet, but if your system is open source and can be easily adapted to our needs (streaming from Phant, many of the issues here) then we'd love to see if there's a way to use your code. 

Thanks,

Jeff

--
You received this message because you are subscribed to the Google Groups "plots-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to plots-dev+...@googlegroups.com.

[James Moulding]

Hi Jeff
The graphing isn't actually that advanced, we are trying to create a way to be able to distribute open data. If you are looking for an open source graphing mechanism we use and love d3js and recommend it.

Best,
James

[Jeffrey Warren]

Yes, Grapherate is based on d3js -- it uses it to make a data-source-agnostic graphing system which could be embedded into different applications. 

Perhaps you'd be interested in using Grapherate as it matures, as part of your widgets? 

https://github.com/jywarren/grapherate

It's very early stage, but the intent is to standardize on data formats, and have it able to display data streams from any source, and be modular and easy to include into a project. 

Jeff

[Jeffrey Warren]

Hi, all -- thanks for your responses, on and off-list. I just wanted to update all that InfoAmazonia has adjusted their site so that it's now compatible with Grapherate -- it was pretty easy: https://github.com/InfoAmazonia/rede-site/issues/71.

And it works now! Awesome! (see below for screenshot)

URL is: http://jywarren.github.io/grapherate/g/?url=http://rede.infoamazonia.org/api/v1/sensors/560ee510860f948069897de3/measurements/ph.csv

As long as there is a public facing CSV or JSON file, it should be pretty straightforward for folks to display *any* data stream in Grapherate. 

When we implement multiple stream graphing, we should also be able to display feeds from multiple sources in the same graph. 

​