Telangana Open Data Portal using DKAN, scope for querying data

[Nikhil VJ]

Hi Folks,

Friends at Telangana Open Data Portal recently showed me recently how the data posted there can be queried via API. This throws up good opportunities to build pages/portals that combine multiple datasets together. (The portal natively has great visualization tools but that is inside a dataset's page) They will even be putting up datasets having lat-longs so there's good mapping opportunities there.

I've shared details here: https://github.com/datameet-pune/datameet-pune.github.io/issues/17

One example:

Monthly maximum temperature data: Query for district = Adilabad, and limit to 2 results:

https://www.data.telangana.gov.in/api/action/datastore/search.json?resource_id=cc9950ce-89aa-455b-847b-d87756db8f91&district=adilabad&limit=2

You can play around with the last part of the URL to get different results.

The data can be pulled in with a simple GET fetch, can be done from simple Javascript.

If you're interested in building something on this together, please let me know.

-----------------

GeoSpatial:

If you know how to implement geospatial stuff on a DKAN platform and have some prior experience in that, please share.

Example: Suppose there is a CSV dataset of public toilets with lat-longs. We want to query to get all toilets withing 10km radius of a given lat-long. We could pull in all the data and perform the geospatial filtering at our end using libraries like turf.js, but it would be cool to have the data portal itself also have such capabilities, plus if the dataset is huge it's better to filter at server end. Then one could even run a generic search like "give me all the data you have in these 50 datasets that's located within 10 km of this lat-long point".

--
Cheers,
Nikhil VJ
+91-966-583-1250
Pune, India
http://nikhilvj.co.in

[Srinivas Karuturi]

Nihkil,

I beg to differ with you on the geospatial aspect and the value of the datasets. They have only been publishing aggregated numbers for data that could be a little more granular. Like for example MeeSeva Transactions/Electricity connections to households etc.. The best example is the Police Stations dataset which is an aggregate number of police stations in a district which is of zero value in my opinion. The baseman of the state along with new district boundaries is not yet publicly available in machine readable formats.

I have been pushing them to publish granular data with little luck.  

Regards,

Srinivas

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Nikhil VJ]

Hi Srinivas,

Thanks for your feedback on the content aspects. The core members are on this group so they'll get it.

I think you misunderstood the subject of my email. I was reaching out regarding the technical potentials of what can be done with a DKAN portal. It could be any dkan portal anywhere. In fact the aim is to have something that is independent of source. The Telangana Open Data portal folks have encouraged me in this, they want people to mash up and play around with what they're bringing together, so that was my starting point.

Example: Open Budgets data site: even there we can pass queries via URL and get filtered results: See example. (click the API button)

Addendum: I just read through this documentation page explaining about CKAN and DKAN. I was not aware earlier :P So from an outside querying perspective, I understand all these portals will be giving same functionality : they can provide data via an API and it is query-friendly.

So what I'm talking about building, could pull in multiple data from any data portal, from any dataset on the portals, and show them on the same page / visualization. Whether the content itself will be useful or not or useful to some and not to others, is none of my business. I just want to work on bringing the tool into existence. So my email was an invitation to programmers for a coding project. The user interface in particular will need a whole lot of work because there'll be so many parameters to manage.

-Nikhil VJ, Pune