Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Is there an ODK / OpenROSA API Primer?
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  17 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Trevor Ellermann  
View profile  
 More options May 9 2012, 5:29 pm
From: Trevor Ellermann <tre...@ellermann.net>
Date: Wed, 9 May 2012 14:29:59 -0700 (PDT)
Local: Wed, May 9 2012 5:29 pm
Subject: Is there an ODK / OpenROSA API Primer?

Hello ODK Community,

I'm a developer and I have just been tasked with implementing the ability
to upload forms and get data back in to our own database in an automated
fashion. Basically they just want to be able to click a button, have it
upload the form and have submission data flow back into our database with
no additional human input aside from people using the collector. Of course
they want this done yesterday as well.

I see that ODK supports the OpenROSA API but I've never used that before.
I'm sure i can figure it out but in the interest of time I was hoping there
was a primer on how to upload forms and get submissions back. I'm sure I'm
not the first person to do this but Google has not really
been yielding much in the way of results. Does such a thing exist? Does
anyone have any advice for me?

Any thoughts at all would be appreciated as I'm suddenly finding myself
under and epic time crunch.

Thanks in advance,

--Trevor


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
James Dailey  
View profile  
 More options May 9 2012, 5:36 pm
From: James Dailey <jamespdai...@gmail.com>
Date: Wed, 9 May 2012 14:36:25 -0700
Local: Wed, May 9 2012 5:36 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?

You might consider publishing from Aggregate to google fusion tables then
using available api to pull into your database.   PHP examples are given on
Google site and rails gem is also available.
On May 9, 2012 2:30 PM, "Trevor Ellermann" <tre...@ellermann.net> wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Yaw Anokwa  
View profile  
 More options May 9 2012, 5:49 pm
From: Yaw Anokwa <yano...@gmail.com>
Date: Wed, 9 May 2012 14:49:03 -0700
Local: Wed, May 9 2012 5:49 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
Another option is to go at it from the phone side of things.

The form submission stuff is pretty straightforward -- it's basically
an HTTP post.
https://bitbucket.org/javarosa/javarosa/wiki/FormSubmissionAPI

The code that does the post lives at
http://code.google.com/p/opendatakit/source/browse/src/org/odk/collec...

Using Aggregate -> Fusion Tables -> your app is potentially more
fragile because there are more pieces that could go wrong. Changing
Collect has less pieces, but then you have your own version of Collect
to maintain.

As far as automating transmission, that's pretty straightforward if
you are familiar with Android. You need a background service that
watches for a network connection and calls the InstanceUploaderTask.
Said service could also send on form save.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Trevor Ellermann  
View profile  
 More options May 9 2012, 5:57 pm
From: Trevor Ellermann <tre...@ellermann.net>
Date: Wed, 9 May 2012 14:57:05 -0700
Local: Wed, May 9 2012 5:57 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
Thanks for the top about fusion tables. I'm new to those as well so I
will look into it.

I notice that in the youtube video about publishing data it talks
about publishing to a JSON server.

http://www.youtube.com/watch?v=Vfl0WxR-xcw

However that is not an option in my Aggregate. It just lists fusion
tables and google docs. JSON would be the perfect answer to getting
the data back into my database. Any idea why I'm not getting that
option?

--Trevor
___________________________
Trevor R. Ellermann
@trevorellermann
K0DMA


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Trevor Ellermann  
View profile  
 More options May 9 2012, 6:00 pm
From: Trevor Ellermann <tre...@ellermann.net>
Date: Wed, 9 May 2012 15:00:33 -0700
Local: Wed, May 9 2012 6:00 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
That form Submission API looks like exactly what I need for uploading
forms. Thanks.

As to changing the Collect code, It's actually part of the
requirements that we don't do that. If I can just get publishing to
JSON to work then I think I have all the pieces I need to get this
working.

Thanks again,

--Trevor

___________________________
Trevor R. Ellermann
@trevorellermann
K0DMA


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
W. Brunette  
View profile  
 More options May 9 2012, 6:30 pm
From: "W. Brunette" <wbrune...@gmail.com>
Date: Wed, 9 May 2012 15:30:21 -0700
Local: Wed, May 9 2012 6:30 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
(please respond with anymore indepth questions to the developers email list).

The publishing to JSON was put on hold while we worked on a new server
to server communication specification in JSON.

Here is a link to the source files
http://code.google.com/p/opendatakit/source/browse?repo=aggregate#hg%...
Basically all the files in external service do the post to the other service.

There are two files JsonServer.java and OhmageJsonServer.java because
of people losing interest those never got finished. If you would like
to finish them we accept patches :) Basically people who were
interested were discussing different API options.

Aggregate actually manages the sending, and resending of data. It just
doesn't know how to post to your desired server so Aggregate needs a
class that implements the ExternalService interface that posts the
submissions to the remote server.
http://code.google.com/p/opendatakit/source/browse/src/main/java/org/...

Waylon


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
W. Brunette  
View profile  
 More options May 9 2012, 6:34 pm
From: "W. Brunette" <wbrune...@gmail.com>
Date: Wed, 9 May 2012 15:34:45 -0700
Local: Wed, May 9 2012 6:34 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
To clarify a bit more JSON was in the 0.9.x versions and when being
brought over to 1.x version of Aggregate. Changes to the protocols
were requested and in the end the people requesting it didn't finish
up the protocol specs. If you want to complete the protocol
specification and provide the translation work to your protocol then
we will be happy to include it.

Waylon


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Trevor Ellermann  
View profile  
 More options May 9 2012, 6:46 pm
From: Trevor Ellermann <tre...@ellermann.net>
Date: Wed, 9 May 2012 15:46:41 -0700
Local: Wed, May 9 2012 6:46 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
Copy that Waylon. Thanks for all of this information. I've joined the
dev list and will bring any further discussion on the JSON topic over
there.

I really appreciate you taking the time to let me know what is going
on with JSON. Now I just need to spend some time to figure out what is
the shortest path to getting data pushed back to my database.

--Trevor

___________________________
Trevor R. Ellermann
@trevorellermann
K0DMA


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Mitch S  
View profile  
 More options May 9 2012, 8:37 pm
From: Mitch S <mitchellsu...@gmail.com>
Date: Wed, 9 May 2012 17:37:29 -0700
Local: Wed, May 9 2012 8:37 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?

Or, if you host Aggregate on your own Tomcat instance, you can set up a
database trigger on the Aggregate database tables and push the data to your
own schema.  This would require a public IP address so the phones can
publish to the server, and you have the SSL certificate process to wade
through if you need https connectivity.

Setting up a trigger would be part of the "upload form".  You could script
this (so you could upload the form, then delve into the Aggregate database
structures and establish the trigger).

The database trigger isolates your app from the table structures used by
Aggregate. I recommend not using those tables directly, as that would make
your app very difficult to migrate to newer versions.  Going forward, the
MODEL_VERSION and UI_VERSION fields will be consolidated into a VERSION
string, for example.

Mitch

On Wed, May 9, 2012 at 3:46 PM, Trevor Ellermann <tre...@ellermann.net>wrote:

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsu...@gmail.com

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Trevor Ellermann  
View profile  
 More options May 9 2012, 9:22 pm
From: Trevor Ellermann <tre...@ellermann.net>
Date: Wed, 9 May 2012 18:22:49 -0700
Local: Wed, May 9 2012 9:22 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
Hey Mitch,

You and I think a lot alike. I've spent the rest of the afternoon
installing the aggregate server on my own machine so I could look
directly at the database tables and upload scripts. I've been trying
really hard to avoid mucking with the ODK code but it's looking like
adding a hook to forward my database any copy of submissions might be
the way to go.

Thanks for the thoughts,

--Trevor
___________________________
Trevor R. Ellermann
@trevorellermann
K0DMA


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Mitch S  
View profile  
 More options May 10 2012, 11:49 am
From: Mitch S <mitchellsu...@gmail.com>
Date: Thu, 10 May 2012 08:49:01 -0700
Local: Thurs, May 10 2012 11:49 am
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?

Yes, you should be able to add database layer triggers in both MySQL and
PostgreSQL
( http://dev.mysql.com/doc/refman/5.5/en/triggers.html and
http://www.postgresql.org/docs/9.1/interactive/triggers.html )
So you can leave the ODK Aggregate code entirely untouched.

You'll want to pay attention to the IS_COMPLETE column in the top level
table for a submission.  Until that is set to true, the record is not
complete and may be missing one or more audio, video or image attachments.

Mitch

On Wed, May 9, 2012 at 6:22 PM, Trevor Ellermann <tre...@ellermann.net>wrote:

...

read more »


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Trevor Ellermann  
View profile  
 More options May 10 2012, 2:00 pm
From: Trevor Ellermann <tre...@ellermann.net>
Date: Thu, 10 May 2012 11:00:23 -0700
Local: Thurs, May 10 2012 2:00 pm
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
Ah I see what you are thinking. Great idea, thanks Mitch.

--Trevor

___________________________
Trevor R. Ellermann
@trevorellermann
K0DMA

...

read more »


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Kisitu Augustine  
View profile  
 More options May 14 2012, 10:36 am
From: Kisitu Augustine <austiin...@gmail.com>
Date: Mon, 14 May 2012 07:36:11 -0700 (PDT)
Local: Mon, May 14 2012 10:36 am
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?

hi guys, so am writing a django app intended to run a celery-task that
pulls data from ODK Aggregate server. does this mean that its impossible
for now ?? if not any ideas i can use??(forgive me if this sounds silly but
cant i even create a socket to do the job??)


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Yaw Anokwa  
View profile  
 More options May 14 2012, 10:43 am
From: Yaw Anokwa <yano...@gmail.com>
Date: Mon, 14 May 2012 07:43:18 -0700
Local: Mon, May 14 2012 10:43 am
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?
Lots of options here. You can stream to Fusion Tables and pull the
data using those APIs. You can look at ODK Briefcase code -- it pulls
data from Aggregate. You can also help finish the JSON export and use
that.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Kisitu Augustine  
View profile  
 More options May 14 2012, 10:57 am
From: Kisitu Augustine <austiin...@gmail.com>
Date: Mon, 14 May 2012 07:57:58 -0700 (PDT)
Local: Mon, May 14 2012 10:57 am
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?

Thanx Yaw ..... am actually thinking of working on that JSON export feature
as soon as i graduate because now on a deadline(May 25th)


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Kisitu Augustine  
View profile  
 More options May 14 2012, 11:21 am
From: Kisitu Augustine <austiin...@gmail.com>
Date: Mon, 14 May 2012 08:21:39 -0700 (PDT)
Local: Mon, May 14 2012 11:21 am
Subject: Re: [ODK Community] Is there an ODK / OpenROSA API Primer?


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Toby Kurien  
View profile  
 More options May 24 2012, 5:22 am
From: Toby Kurien <tobykur...@gmail.com>
Date: Thu, 24 May 2012 02:22:43 -0700 (PDT)
Local: Thurs, May 24 2012 5:22 am
Subject: Re: Is there an ODK / OpenROSA API Primer?

I am investigating a totally different method. I am also trying to save ODK
form submissions to a SQL database, and then use a Web GUI for the SQL
database to view and analyse the submission data. So, much of the ODK
Aggregate functionality is not actually needed. I found this old project:

http://code.google.com/p/opendatakit/source/browse/?repo=dropbox

This is a very simple python-based ODK Aggregate server (essentially). It
can host forms, and accept submissions from ODK Collect. It currently
writes the submissions to the file system, so I thought of modifying it to
write the submissions to a database as well (and maybe re-submit the
submission to an actual ODK Aggregate server or Fusion tables, if needed).
I cloned it and modified it to work with ODK Collect v1.1.7. The project is
here:

http://code.google.com/r/tobykurien-odk-submitodb/

I am now going to modify it to write the submission data to a MySQL
database. Anyone is welcome to collaborate with me on this project.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »