[iROD-Chat:4010] help on ireg command

[Alinga Yeung]

Hi,

I am trying to use the ireg command to test registering 20 millions files, but I am not having any luck. It is probably because I am not using the ireg command correctly.

The files are in thorin:/archive/0a4d03c6/test/files
I am trying to register the files to /tempZone/home/irodsadm/TEST/test/files

If I create the collection /tempZone/home/irodsadm/TEST/test/files prior to executing ireg, I get "iRODSPath ... already exist" error.
If I do not have the files collection created, I get "No such file or directory" error.

Am I not using ireg correctly?

Thank you.

Alinga

=====
392:thorin:/archive/0a4d03c6/test ils -L
/tempZone/home/irodsadm/TEST/test:
  C- /tempZone/home/irodsadm/TEST/test/files
393:thorin:/archive/0a4d03c6/test ipwd
/tempZone/home/irodsadm/TEST/test
394:thorin:/archive/0a4d03c6/test ireg -G rgtest -R cadc05e1510c -C /archive/0a4d03c6/test/files /tempZone/home/irodsadm/TEST/test/files
ERROR: regUtil: iRODSPath /tempZone/home/irodsadm/TEST/test/files already exist
395:thorin:/archive/0a4d03c6/test irm -U -r files
396:thorin:/archive/0a4d03c6/test ils -L
/tempZone/home/irodsadm/TEST/test:
397:thorin:/archive/0a4d03c6/test ireg -G rgtest -R cadc05e1510c -C /archive/0a4d03c6/test/files /tempZone/home/irodsadm/TEST/test/files
ERROR: regUtil: reg error for /tempZone/home/irodsadm/TEST/test/files, status = -522002 status = -522002 UNIX_FILE_OPENDIR_ERR, No such file or directory
398:thorin:/archive/0a4d03c6/test ils -L
/tempZone/home/irodsadm/TEST/test:
  C- /tempZone/home/irodsadm/TEST/test/files
399:thorin:/archive/0a4d03c6/test ireg -G rgtest -R cadc05e1510c -C /archive/0a4d03c6/test/files /tempZone/home/irodsadm/TEST/test/files
ERROR: regUtil: iRODSPath /tempZone/home/irodsadm/TEST/test/files already exist
400:thorin:/archive/0a4d03c6/test
=====

--
"iRODS: the Integrated Rule-Oriented Data-management System; A community driven, open source, data grid software solution" https://www.irods.org
 
iROD-Chat: http://groups.google.com/group/iROD-Chat

[mw...@diceresearch.org]

Alinga,

>97:thorin:/archive/0a4d03c6/test ireg -G rgtest -R cadc05e1510c -C /archive/0a4d03c6/test/files /tempZone/home/irodsadm/TEST/test/files
>ERROR: regUtil: reg error for /tempZone/home/irodsadm/TEST/test/files, status = -522002 status = >-522002 UNIX_FILE_OPENDIR_ERR, No such file or directory

Does this directory /archive/0a4d03c6/test/files exist on the server where the resource cadc05e1510c is

located ?

Mike

[Alinga Yeung]

On Wed, May 12, 2010 at 10:09 AM, <mw...@diceresearch.org> wrote:

Alinga,

>97:thorin:/archive/0a4d03c6/test ireg -G rgtest -R cadc05e1510c -C /archive/0a4d03c6/test/files /tempZone/home/irodsadm/TEST/test/files
>ERROR: regUtil: reg error for /tempZone/home/irodsadm/TEST/test/files, status = -522002 status = >-522002 UNIX_FILE_OPENDIR_ERR, No such file or directory

Does this directory /archive/0a4d03c6/test/files exist on the server where the resource cadc05e1510c is

located ?

No, this directory /archive/0a4d03c6/test/files exists on thorin, whereas the resource is located in thrain.
======
402:thorin:/archive/0a4d03c6/test iadmin lr cadc05e1510c
resc_id: 11694
resc_name: cadc05e1510c
zone_name: tempZone
resc_type_name: unix file system
resc_class_name: archive
resc_net: thrain.cadc.dao.nrc.ca
resc_def_path: /archive/05e1510c
free_space: 862262
free_space_ts: 01273680164 : 2010-05-12.09:02:44
resc_info:
r_comment:
resc_status: auto-up
create_ts: 01273253826 : 2010-05-07.10:37:06
modify_ts: 01273680164 : 2010-05-12.09:02:44
======
403:thorin:/archive/0a4d03c6/test ls /archive
0a4d03c6/  0b2e8665/  51f37291/  67c66423/  6bcb8aa3/  9cfb870b/  bf7a0ec7/  da786532/  xxtestxx/
404:thorin:/archive/0a4d03c6/test
======

Alinga
 

[mw...@diceresearch.org]

>No, this directory /archive/0a4d03c6/test/files exists on thorin, whereas the resource is located in thrain

Well, you have to make a resource with the address in thrain (e.g, rescThrain) and using

"ireg -RrescThrain ..." to register the directory.

Mik

[Alinga Yeung]

On Wed, May 12, 2010 at 10:51 AM, <mw...@diceresearch.org> wrote:

>No, this directory /archive/0a4d03c6/test/files exists on thorin, whereas the resource is located in thrain

Well, you have to make a resource with the address in thrain (e.g, rescThrain) and using

"ireg -RrescThrain ..." to register the directory.

I see. Since the 20 million files are in thorin, I have started ireg using a storage resource on thorin. Now both the source and the destination are in thorin. ireg seems to be running now.

Thank you.

Alinga

[Alinga Yeung]

On Wed, May 12, 2010 at 11:16 AM, Alinga Yeung <alinga.i...@gmail.com> wrote:

On Wed, May 12, 2010 at 10:51 AM, <mw...@diceresearch.org> wrote:

>No, this directory /archive/0a4d03c6/test/files exists on thorin, whereas the resource is located in thrain

Well, you have to make a resource with the address in thrain (e.g, rescThrain) and using

"ireg -RrescThrain ..." to register the directory.

I see. Since the 20 million files are in thorin, I have started ireg using a storage resource on thorin. Now both the source and the destination are in thorin. ireg seems to be running now.

 

If I understand it correctly, ireg requires both the source and the destination to be on the same server.

Since we are not copying files but are generating meta data for the files to be stored in the iCAT server, what is the reason for this limitation?

Thank you.

Alinga

[mw...@diceresearch.org]

All the files will be registered with this resource where the files are located.

If the resource is on different server, next time when you do an iget of the

file, it will go to the wrong sever.

[Alinga Yeung]

On Wed, May 12, 2010 at 12:36 PM, <mw...@diceresearch.org> wrote:

All the files will be registered with this resource where the files are located.

If the resource is on different server, next time when you do an iget of the

file, it will go to the wrong sever.

Understood. Thank you for the explanation Mike.

Alinga

[ramius]

Hello Mike,

I think i am having the same problem here.  Just to make sure i understood correctly this is my situation

my main iRODS installation and resource ABC are on server1  

I have some file on server2

I mount the data physically on server2 in a XYZ folder in server1

From server1 I use ireg to register the data in XYZ on the irods resource ABC

and this cannot be done. The correct way is to install irods in server2, create a local resource ZXC and then register the 

files directly from server 2 on the local resource ZXC    

Am i correct?