gridftp, dcache and univMSSdriver.sh

[Robert verkerk]

Hi,

We want to create the following configuration:

irods client<=> irods server (compound resource vault)<=gridFTP=> dCache

We know we should/could accomplish this using the "univMSSInterface.sh" script. Does anybody have a working iRODS V3.0 configuration and is
willing to share the info about the setup. For instance the installed packages and the contents of "univMSSInterface.sh".

Or are there other ways to accomplish this functionality?

greetings,

Robert Verkerk

[Chris Jordan]

I have successfully set up an iRODS 3.0 server with a compound resource and the "univMSSinterface.sh" script, with a simple SSH/SCP-based set of transfer commands for interacting with a remote archive. I'd be happy to share that script if you think it would be helpful - everything else is pretty straightforward.

Thanks

--
"iRODS: the Integrated Rule-Oriented Data-management System; A community driven, open source, data grid software solution"   https://www.irods.org

iROD-Chat:  http://groups.google.com/group/iROD-Chat

--
Chris Jordan

-------------------
Texas Advanced Computing Center

---------------------

[Jean-Yves Nief]

hello,

Robert verkerk wrote:
> Hi,
>
>
> We want to create the following configuration:
>
> irods client<=> irods server (compound resource vault)<=gridFTP=>
> dCache
>
> We know we should/could accomplish this using the
> "univMSSInterface.sh" script. Does anybody have a working iRODS V3.0
> configuration and is
> willing to share the info about the setup. For instance the installed
> packages and the contents of "univMSSInterface.sh".

univMSSInterface.sh is going to use the shell commands that you wish to
use to interact with dCache, hence in your case it will be gridFTP.
You can take a look at the sample univMSSInterface.sh script which gives
you an example.
Information is also available here:
https://www.irods.org/index.php/Universal_Mass_Storage_System_driver
cheers,
JY

[Jean-Yves Nief]

Robert verkerk wrote:
> Hi,
>
> Chris thanks for the offer. We are interested to see it as an example
> for transferring data to/from an external source.
>
> But we are still also interested in an example/setup between an iRODS
> server and dCache. This because this has to use a grid certificate and
> all (f.i. gridftp). And that's where our challenge lies.
take a lot at thread 6222. Samuel Lampa from Sweden has made some work
on it and dealt with proxy certificates. You can contact him I think.
JY
>
> greetings,
>
> Robert Verkerk

> Met vriendelijke groet,
>
> Robert Verkerk
> systeem programmeur
> Data Services
>
> SARA
> Science Park 140
> 1098 XG Amsterdam
> T +31 (0)20 592 3000
> F +31 (0)20 668 3167
> M +31 (0)6 19949203
> Erobert...@sara.nl
> www.sara.nl

[Chris Jordan]

I've attached a copy of a very simple ssh-based MSS interface - note that the stat call is not implemented in this version as I didn't get a chance to test my early implementation of the stat code. But this gives a good idea of how simple it is to implement this driver - as long as you know how to interact with a remote resource it is quite straightforward to put those interactions into this script. GridFTP should be pretty easy to do in this context, you'll just need to set up (and perhaps check) the GSI environment within the script, and there is an example of doing that in this script with the $ARCHIVE and $ARCHUSER variables.

A "real" implementation would probably include more error-checking and use variables for all the commands, but this is meant to be a simple example and even as simple as it is, it does work.

Thanks

[Robert verkerk]

Hi Chris and everyone who replied,

Thanks for the info.

We will have a look at the example and try to contact Samuel Lampa in
Sweden to get it working.

greetings,

Robert verkerk

[Qian Liu]

Hi,

I noticed there will be errors as following when installing iRODS3.0 on CentOS6.2 X86_64 (64bit):

Step 4 of 6: Configuring database security...
Updating Postgres pg_hba.conf...
Skipped. File already uptodate.
Stopping database server...
Starting database server...
Testing database communications...

Configuration problem:
Communications with the database failed.
ERROR: cllConnect: SQLConnect failed: -1
ERROR: cllConnect: SQLConnect failed:odbcEntry=PostgreSQL,user=irods,pass=8arC0de
ERROR: cllConnect: SQLSTATE: S1000
ERROR: cllConnect: Native Error Code: 101
ERROR: cllConnect: [unixODBC]Could not connect to the server;
Could not connect to remote socket.
userName=irods
password=8arC0de

Abort.
Set up failed. Please see the log file for details:
/home/irods/iRODS/installLogs/finishSetup.log
The server/log/rodsLog* file may also contain useful information.

I also tried to install iRODS3.0 on CentOS6.2-i386 (32bit) and it works well.
It seems that communication between database and irods server got problem.
I tried to install iRODS3.0 on CentOS6.0 X86_64 it work also.

Any clue that we can make iRODS3.0 work with CentOS6.2 X86_64? Or I have to fall back to older distrubution of CentOS.

Thanks!

-Qian

Qian Liu, Calit2, UCSD

[she...@diceresearch.org]

Please check that Postgresql DBMS is up & running OK

and try if you can using Postgresql's client  psql

to connect to ICAT ??

ie.  /path-to/pgsql/bin/psql  ICAT

[Qian Liu]

Sheauyen,

Acturally I read one of the Wayne's old email logs which suggested to use environment variable USE_LOCALHOST and it works now after I set up USE_LOCALHOST.

I guess the makefile for X86_64 could missed some setup for this.

Thanks!

-Qian

[Jonas Hagberg]

Hej

You can find our work on github.

https://github.com/UPPMAX/irods

Our adaption is here.

https://github.com/UPPMAX/irods/blob/master/server/bin/cmd/univMSSInterface.sh 

Cheers

/Jonas Hagberg AdviseIT