Building the guidelines/standards for Open Data Initiative.

1 view
Skip to first unread message

Ajay Kumar

unread,
Jul 7, 2010, 6:13:30 AM7/7/10
to ictd...@googlegroups.com, ictd-asi...@googlegroups.com
Hi Jeff,
Sorry for the delayed reply. (also changing subject line)

On 25 June 2010 00:58, Jeff Sonstein <json...@gmail.com> wrote:

> Now the next step would be to devise a methodology for the same. Anyone with an experience with playing around with data and standards, can help us suggest a better way to approach this.

a few things I'd suggest might be quite useful
in the intermediate- and long-term
(despite being a bit of work in the short-term)
as we have found in our recent work with
the US Federal Election Commission data/files:

1) develop relationship diagrams (linking)

related data is often stored in multiple files
even files in multiple locations w multiple access methods
and having documentation of what keys link different data
is very valuable in figuring out how to
form coherent & integrated information for the citizen-user
in applications and servers developed by the group

2) develop schemas & convert data to XML-form (defining)

clear definitions of data structure & constraints is critical
to understanding and manipulating it
and is often either present alongside the files in "metadata"
or can be constructed through examination of the data

with the data in XML-form conforming to your schemata
transformations and queries of the data
as well as reformation of logically-linked data
into more useful files/documents
becomes much much easier
as does producing useful outputs for citizen-users

3) develop open RESTful API(s) for access

this is a very powerful way to ensure
client and server code and logic is disentangled
thus enabling others not in the group
to also develop their own clients
as well as enabling the development of
unexpected (at the front end of development)
uses of the data

take Twitter as an example of this...
part of their success is because
they enabled a client-code-focused ecosystem to develop
through separating client & server code
and through keeping an open RESTful API


I have been digging up resources on this myself. But yes, they seem lot of work right now. I'd suggest we put these on our wiki page so that new people dont get confused and have something very simple to follow.

As for me, I am working on the CWC Water data, since I could use it for decision making process at our DRR Project since the flood phase is approaching. (any help there by coders is appreciated ;) )

So for now, I am gonna just do a quick hack for what I need and meanwhile we can work on something proper keeping in mind the long term suggestions like yours.

I'd suggest other's who are interested in this area to help us build the guidelines on the wiki under http://ictd.asia/wiki/Open_Data_Initiative

More soon!


--
Best Regards,

Ajay Kumar

http://www.ajuonline.net

Jeff Sonstein

unread,
Jul 8, 2010, 8:52:50 AM7/8/10
to ictd-asi...@googlegroups.com, ictd...@googlegroups.com
Ajay:

it is summertime here
so I sometimes don't "get around to" checking email
for a day or two
(lazy sloth that I can be <grin/>)

On Jul 7, 2010, at 6:13 AM, Ajay Kumar wrote:

> > Now the next step would be to devise a methodology for the same. Anyone with an
> > experience with playing around with data and standards, can help us suggest a better way to approach this.
>
> >> a few things I'd suggest might be quite useful

> >> in the intermediate- and long-term [...]


> I'd suggest we put these on our wiki page so that new people dont get confused and have something very simple to follow.

what would you like as a title for a new wiki page?
strategies? longer-term tasks? guidelines? or <fill_in_the_blank/>?
I don't mind initially being the voice of
"thinking past the problem-of-today"

> As for me, I am working on the CWC Water data, since I could use it for decision making process at our DRR Project since the flood phase is approaching. (any help there by coders is appreciated ;) )

come September and the start of the new academic year here
it will be easier to recruit folks
particularly if there is a page up
specifying clearly what a project is and what help is needed

jeffs

--
Lyndon Johnson said the two things that
make politicians behave more stupidly
than anything else are sex and envy. You
might add one more: proximity. I always
think men are more prone to get seduced
by proximity into making unwise choices.
They tend to be a bit lazy. They'll grab the
closest doughnut off the platter.
- Maureen Dowd -
============

Prof. Jeff Sonstein

http://www.ist.rit.edu/~jxs/
http://ariadne.iz.net/~jeffs/
http://chw.rit.edu/blog/
http://ariadne.iz.net/~jeffs/jeffs.asc
http://www.it.rit.edu/~jxs/emailDisclaimer.html

Ajay Kumar

unread,
Jul 12, 2010, 9:58:00 AM7/12/10
to Jeff Sonstein, ictd-asi...@googlegroups.com, ictd...@googlegroups.com


On 8 July 2010 18:22, Jeff Sonstein <json...@gmail.com> wrote:
Ajay:

what would you like as a title for a new wiki page?
strategies? longer-term tasks? guidelines? or <fill_in_the_blank/>?
I don't mind initially being the voice of
"thinking past the problem-of-today"
Yes. That'd be awesome for you to help us with this. I am still new to this concept and learning, and trying "quick hacks" to get things done as needed. So I suggest having a section as suggested "Strategies" for our ODI (i think this is an appropriate word) here http://ictd.asia/wiki/Open_Data_Initiative as a heading. 


> As for me, I am working on the CWC Water data, since I could use it for decision making process at our DRR Project since the flood phase is approaching. (any help there by coders is appreciated ;) )

come September and the start of the new academic year here
it will be easier to recruit folks
particularly if there is a page up
specifying clearly what a project is and what help is needed

I have been working on this and a friend of mine has written some code up as well. We are trying to currently link it up with the location data managed separately and then the needed information. Putting that up on the wiki page as we speak. As for the code http://ictd.asia/code/floodforecast.py that @neenaoffline wrote(Thanks!!). Just an initial hack that pulls up data from http://www.india-water.com/ffs/static_info.asp?Id=89
where ID currently ranges from 1-180 i think.

I am working on the DB structure to link it and save the data in an organized way. Updating it on http://ictd.asia/wiki/Open_Data_Initiative_India as well.
Reply all
Reply to author
Forward
0 new messages