ICAT Data Server

17 views
Skip to first unread message

Daniel Salvat (ALBA/CELLS)

unread,
Dec 10, 2012, 10:43:44 AM12/10/12
to icat-de...@googlegroups.com
Dear all,

Since we're working on the integration of ICAT in ALBA, some issues have come up. In this case, we are looking for solutions in terms of downloading the data files from TopCAT.
We've been doing some research and no solution seems to appear but developing it by ourselves (see http://icatproject.googlecode.com/svn/meetings/NOBUGS2012Talks/NOBUGS_2012_data_download.pdf page 3 and so on). Perhaps we are not looking in the right places.

Could you please give us some advice in this? Is there any implementation we could use besides building our own Data Server from scratch? Would it be needed to customize our TopCAT to have our Data Server working properly? I understand this is not what it is intended, but we are having the strong feeling this customization would be needed to be done.

Thank you very much.

ALBA Team.

antony...@stfc.ac.uk

unread,
Dec 10, 2012, 12:22:22 PM12/10/12
to icat-de...@googlegroups.com
Dear All

We are just starting on the icat data service.

Where we are at the moment:
ISIS have their own download service. All their data are on disk. The location stored in ICAT is a url which will connect you to the download service and initiate download of the file
This is currently the default download mechanism in topcat

Diamond have a different download service. All of their data are held on tape. This is the restfulDownload service, which it is currently fairly specific to diamond.

The Central Laser Facility have another service. Topcat does not talk to this.

We have been working on the specification for a data service that will allow upload and download of data and will be generic enough to meet all our known requirements. This is more or less finished now. We have a new member of staff who has just started implementing the download section of the new interface on the Diamond restfulDownload service. There is a very close match between the existing interface and the new one. We will then reuse as much code as possible to form the basis for the reference implementation. The reference implementation will use a single on-line storage solution. In the meantime I will be updating topcat so it uses the new interface. The reference implementation code will be put in google code at http://code.google.com/p/icat-data-service/, we are still some way off doing this. Additional effort is always welcome. The specification and our project plans can be found from the google code site.

ISIS are also waiting for the reference implementation which they will be using as the bases for their new implementation.

Regards
Antony

________________________________
From: icat-de...@googlegroups.com [icat-de...@googlegroups.com] on behalf of Daniel Salvat (ALBA/CELLS) [daniel...@gmail.com]
Sent: 10 December 2012 15:43
To: icat-de...@googlegroups.com
Subject: ICAT Data Server
--
http://groups.google.com/group/icat-developers
--
Scanned by iCritical.
Reply all
Reply to author
Forward
0 new messages