Resource management.

[Holger Naundorf]

Hello,
I was wondering if there is an easy way to see how much space is left on a resource defined in iRODS (i.e. using basic iRODS commands).

If I use something like 'iadmin lr <NAME> -v' I just get an empty field:

[irods@irods ~]$ iadmin lr XXXX -v
resc_id: 10005
resc_name: XXXX
zone_name: XXXX
resc_type_name: unixfilesystem
resc_net: XXXXX
resc_def_path: /opt/iRODS/Vault
free_space:
free_space_ts Never
resc_info:
r_comment:
resc_status:
create_ts 2016-09-26.14:47:16
modify_ts 2017-01-19.13:32:57
resc_children:
resc_context:
resc_parent:
resc_objcount: 788


In the same vein: Is the an access control/quota for resources? I can add ACL and quotas to files within the logical iRODS filesystem, but can I set permissions or user quotas on the resource level? I.e. I have a 'expensive' resources and 'cheap' resources and a userbase which in priciple has access to all data but depending on how much they can afford to pay for their storage should only have access to a certain quality (and amount of) of resources.

Regards,
Holger Naundorf

[John Constable]

Hi Holger,

 

If you’re using unixfilesystem resources, you can take advantage of some architecture designed to stop the filesystem filling up – adding some rules that automatically update the freespace value.

https://docs.irods.org/4.1.10/manual/architecture/ (look for ‘UnixFileSystem’)

 

We also run a script every few mins that does the same thing as the rules are only triggered by parallel transfers, so there could be a trickle of small files that might fill up the resource..

 

I don’t believe there is any resource level quota, but you might achieve the same thing with rules, or, possibly, using federated resources, and have each federee a different storage pool and quota.  We have some zones that multiple group can access but have a quota, and others that only one group an write to, but have no quota, as an example..

--
--
"iRODS: the Integrated Rule-Oriented Data-management System; A community driven, open source, data grid software solution" https://www.irods.org
 
iROD-Chat: http://groups.google.com/group/iROD-Chat

---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

[Terrell Russell]

There are resource-level quotas available, but they are managed through users and groups, not directly.

  https://docs.irods.org/4.2.0/icommands/administrator/#suq

Here is an example of showing a quota for the root of a resource tree (compResc).

I have a 100MiB file that is replicated, and a quota of 40MB.

I am currently over quota by about 160MiB.

$ ilsresc
compResc:compound
├── cacheResc
└── wosResc
demoResc

$ iadmin suq rods compResc 40000000

$ ils -L
/tempZone/home/rods:
  rods              1 compResc;wosResc    104857600 2017-03-14.13:47 & 100M
    sha2:IEkqTQ2E+L6xdn9mFiKfhdRMKCe2S9v7Jg7hL6EQng4=    generic    /tmp/irods/wosvault/home/rods/100M
  rods              2 compResc;cacheResc    104857600 2017-03-14.13:47 & 100M
    sha2:47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=    generic    /tmp/irods/cachevault/home/rods/100M

$ iadmin cu

$ iadmin lq
Per resource quotas (if any) for users/groups:
user_name: rods
zone_name: tempZone
resc_name: compResc
quota_limit: 40000000
quota_over: 169715200
modify_ts 2017-03-15.12:26:14

Global (total usage) quotas (if any) for users/groups:
No rows found

The quotas are not hard-enforced by default.  Changing the default would be an update to your rules/policy.

Specifically, look for acRescQuotaPolicy

See https://github.com/irods/irods/blob/4-1-stable/packaging/core.re.template#L638-L645

Terrell

To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

--

--
"iRODS: the Integrated Rule-Oriented Data-management System; A community driven, open source, data grid software solution" https://www.irods.org
 
iROD-Chat: http://groups.google.com/group/iROD-Chat

---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.

To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+unsubscribe@googlegroups.com.