Does Ckan give the possibility to save in different file formats?

[Tine Müller]

Does Ckan give the possibility to save in different file formats? Or do you have to upload this different file formats yourself for other people to download?

Dbh
Tine Müller
findtoilet.dk

[Knud Möller]

Hi Tine,

as far as I know, the way to enable file upload for users is to use the FileStore extension. FileStore will leave the uploaded files unchanged, and so will not try to convert them to other formats (that’s also not always a trivial task). So, I guess the answer is: people will have to upload their data in different formats themselves.

Cheers,

Knud

--
You received this message because you are subscribed to the Google Groups "CKAN Global User Group (Non-technical questions)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ckan-global-user-...@googlegroups.com.
To post to this group, send email to ckan-global...@googlegroups.com.
Visit this group at https://groups.google.com/group/ckan-global-user-group.
To view this discussion on the web, visit https://groups.google.com/d/msgid/ckan-global-user-group/63856e7d-a320-475f-a3d6-b652b3a72a20%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

-- 

Dr. Knud Hinnerk Möller

Datalysator - Web Data Solutions and Training

kn...@datalysator.com

+49 151 46 44 83 25

[Tine Müller]

Thanks. In my service made in Drupal councils only have to paste in their info about toiletdata and Drupal give access for ALL to use this data in several formats http://beta.findtoilet.dk/feeds/municipality. More about this http://findtoilet.dk/apps/

Think Ckan has a LOT of problems for developers trying to use the data and have told about this many times before in the last couple of years for instance you can't see when data it updated and which data. My thoughts and frustrations about this http://bit.ly/1TJBkZL

Dbh
Tine

Den mandag den 29. maj 2017 kl. 13.50.58 UTC+2 skrev Knud M?ller:

Hi Tine,

as far as I know, the way to enable file upload for users is to use the FileStore extension. FileStore will leave the uploaded files unchanged, and so will not try to convert them to other formats (that’s also not always a trivial task). So, I guess the answer is: people will have to upload their data in different formats themselves.

Cheers,

Knud

On 29 May 2017 at 08:00:55, Tine Müller (tinem...@gmail.com) wrote:

Does Ckan give the possibility to save in different file formats? Or do you have to upload this different file formats yourself for other people to download?

Dbh
Tine Müller
findtoilet.dk

--
You received this message because you are subscribed to the Google Groups "CKAN Global User Group (Non-technical questions)" group.

To unsubscribe from this group and stop receiving emails from it, send an email to ckan-global-user-group+unsub...@googlegroups.com.

To post to this group, send email to ckan-global...@googlegroups.com.
Visit this group at https://groups.google.com/group/ckan-global-user-group.
To view this discussion on the web, visit https://groups.google.com/d/msgid/ckan-global-user-group/63856e7d-a320-475f-a3d6-b652b3a72a20%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Ian Ward]

For tabular data loaded into the CKAN datastore you can export it as
XLSX, CSV, TSV or JSON formats
http://docs.ckan.org/en/latest/maintaining/datastore.html?highlight=datastore#download-resource
Those urls aren't exposed by default, you just need to add a couple
lines to your theme to link to them.

Otherwise users would need to upload each format they want exported or
build an extension that does the conversion for them.

Ian

>> email to ckan-global-user-...@googlegroups.com.

>> To post to this group, send email to ckan-global...@googlegroups.com.
>> Visit this group at
>> https://groups.google.com/group/ckan-global-user-group.
>> To view this discussion on the web, visit
>> https://groups.google.com/d/msgid/ckan-global-user-group/63856e7d-a320-475f-a3d6-b652b3a72a20%40googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>
>> --
>> Dr. Knud Hinnerk Möller
>> Datalysator - Web Data Solutions and Training
>> kn...@datalysator.com
>> +49 151 46 44 83 25
>>

> --
> You received this message because you are subscribed to the Google Groups
> "CKAN Global User Group (Non-technical questions)" group.
> To unsubscribe from this group and stop receiving emails from it, send an

> email to ckan-global-user-...@googlegroups.com.

> To post to this group, send email to
> ckan-global...@googlegroups.com.
> Visit this group at https://groups.google.com/group/ckan-global-user-group.
> To view this discussion on the web, visit

> https://groups.google.com/d/msgid/ckan-global-user-group/3d7e19d1-c6e2-428a-8982-f020c04788dd%40googlegroups.com.

[Florian May]

Hi Tine,

(edit: apparently my answer didn't mail out - WA internet is flaky on good days and that was not one of them.)

generally, no - CKAN file resources will normally preserve the file format.

Some extensions may convert file types, e.g. geopusher converts ESRI shapefiles to GeoJSON: http://extensions.ckan.org/extension/geopusher/ 

CSVs (especially those passing http://goodtables.okfnlabs.org/) are turned into database tables by the datapusher extension, and data returned by the API comes in JSON format, which is different from the original CSV format. http://docs.ckan.org/en/latest/api/#making-an-api-request

I advocate for my users to upload files, where possible, in standard file formats - PDF for documents, CSV for data, TXT for code (unless it's a workbook, in that case we also take HTML of the rendered version), PDF / PNG for vector / raster graphics, JPEG for photos, GeoJSON for spatial data. This greatly reduces the need for different file formats and the possible confusion of version conflicts but YMMV.

It would be possible to create a new CKAN extension to provide format conversion for you: http://docs.ckan.org/en/latest/extensions/index.html

Hope that helps!

Florian

--

You received this message because you are subscribed to the Google Groups "CKAN Global User Group (Non-technical questions)" group.

To unsubscribe from this group and stop receiving emails from it, send an email to ckan-global-user-group+unsub...@googlegroups.com.
To post to this group, send email to ckan-global-user-group@googlegroups.com.

[Tine Müller]

Thanks for your reply but my biggest problem as a developer is:

[Steven De Costa]

Hi Tine,

I read through the post related to your thoughts and frustrations (via google translate).

I think there are two things to mention here, which I hope will be useful for your efforts:

1. CKAN is primarily a catalogue of data. As such, it is something of an edge use case for CKAN to proactively monitor data resource endpoints from it's side an update the metadata to reflect when updates to resources are made.

2. Much of what I believe you have referenced about issues appear to be related to the data itself. This appears to be out of scope for CKAN as a product and more about the quality standards employed by those who use it (noting that even the CKAN platform admins may not have the reach to ensure quality of resources they are collating).

Having made those points, I can let you know that it is not too difficult to monitor data resource endpoints and check for updates programmatically, even if the CKAN environment used for discovery does not alert on such updates.

CKAN's API can be used to solve such update situations and record the change in metadata values, but this does require consideration of the platform managers or data custodians in each case.

Lastly, I'd just point out that the principles surrounding open data do revolve around participation, collaboration and transparency. That a jurisdiction publishes data is certainly good but success does come from an ongoing effort to engage with the community and ensure both the data and the portal is fit for its intended purpose. It sounds like your frustrations are related to an ongoing and maturing open data program. Your voice is extremely important so please don't give up hope or feel dissuaded from making yourself heard.

Cheers,

Steven

On Mon, Jun 5, 2017 at 5:23 PM Tine Müller <tinem...@gmail.com> wrote:

Thanks for your reply but my biggest problem as a developer is:

"Think Ckan has a LOT of problems for developers trying to use the data and have told about this many times before in the last couple of years for instance you can't see when data it updated and which data. My thoughts and frustrations about this http://bit.ly/1TJBkZL"

--
You received this message because you are subscribed to the Google Groups "CKAN Global User Group (Non-technical questions)" group.

To unsubscribe from this group and stop receiving emails from it, send an email to ckan-global-user-...@googlegroups.com.
To post to this group, send email to ckan-global...@googlegroups.com.

Visit this group at https://groups.google.com/group/ckan-global-user-group.

To view this discussion on the web, visit https://groups.google.com/d/msgid/ckan-global-user-group/9d7d6550-b0a9-4822-bcd1-b71f582bd327%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

STEVEN DE COSTA | EXECUTIVE DIRECTOR
www.linkdigital.com.au