"instance_name": "irods_rule_engine_plugin-unified_storage_tiering-instance",
"plugin_name": "irods_rule_engine_plugin-unified_storage_tiering",
"plugin_specific_configuration": {
}
}
iadmin mkresc storageResc1 unixfilesystem 7b7f768cbf5c:/var/lib/irods/storageVault1
iadmin mkresc storageResc2 unixfilesystem 7b7f768cbf5c:/var/lib/irods/storageVault2
iadmin mkresc replResc replication
iadmin addchildtoresc replResc storageResc1
iadmin addchildtoresc replResc storageResc2
3) Created a storage resource. This would be slow tier.
iadmin mkresc tapeResc unixfilesystem 7b7f768cbf5c:/var/lib/irods/storageVaultTape
4) Created a tier group
imeta add -R replResc irods::storage_tiering::group example_group 0
imeta add -R tapeResc irods::storage_tiering::group example_group 1
5) Set tiering policy so files are copied to slow tier after 5 seconds
imeta add -R replResc irods::storage_tiering::time 5
6) Added a file to fast tier
iput -R replResc foo.txt
The problem is file is never copied to the slow tier (tapeResc) -- It should after 5 seconds passing. but it remains on fast tier (replResc)
Thanks for your help.
Jason Coposky
Executive Director, iRODS Consortium
RENCI at the University of North Carolina at Chapel Hill
w: (919)445-9675
m: (919)522-0517
jas...@renci.org
------
Jason Coposky
Executive Director, iRODS Consortium
RENCI at the University of North Carolina at Chapel Hill
w: (919)445-9675
m: (919)522-0517
jas...@renci.org
We have a slightly different one;
{
"rule-engine-instance-name": "irods_rule_engine_plugin-storage_tiering-instance",
"rule-engine-operation": "irods_policy_schedule_storage_tiering",
"delay-parameters": "<INST_NAME>irods_rule_engine_plugin-storage_tiering-instance</INST_NAME><PLUSET>1s</PLUSET><EF>30m REPEAT FOR EVER</EF>",
"storage-tier-groups": [
"ega_transfer_group"
]
}
INPUT null
OUTPUT ruleExecOut
So I think you will need to modify yours to;
{
"rule-engine-instance-name": "irods_rule_engine_plugin-unified_storage_tiering-instance",
"rule-engine-operation": "irods_policy_schedule_storage_tiering",
"delay-parameters": "<INST_NAME>irods_rule_engine_plugin-unified_storage_tiering-instance</INST_NAME><PLUSET>1s</PLUSET><EF>1h
REPEAT FOR EVER </EF>",
"storage-tier-groups": [
"example_group_g2",
"example_group"
]
}
INPUT null
OUTPUT ruleExecOut
Might be worth some testing around the Execution Frequency (EF), depending on your requirements Sandi?
Hope that helps,
John
Thanks,
------
Jason Coposky
Executive Director, iRODS Consortium
RENCI at the University of North Carolina at Chapel Hill
w: (919)445-9675
m: (919)522-0517
jas...@renci.org
From: irod...@googlegroups.com <irod...@googlegroups.com> on behalf of kxk...@gmail.com <kxk...@gmail.com>
Sent: Thursday, May 27, 2021 11:35 AM
To: iRODS-Chat <irod...@googlegroups.com>
Subject: [iROD-Chat:19797] Storage Tiering Rule Engine Plugin question
Hi,
I am trying to setup Storage Tiering Rule Engine Plugin on y local instance of irods server (version 4.2.8) and it does not seem to work. Any help is appreciated.
Followed the instructions at https://github.com/irods/irods_capability_storage_tiering [github.com]
Here is a list of what I did.
1) Added the following to the 'rule_engines' section of /etc/irods/server_config.json and restarted irods server via irodsctl restart
{
"instance_name": "irods_rule_engine_plugin-unified_storage_tiering-instance",
"plugin_name": "irods_rule_engine_plugin-unified_storage_tiering",
"plugin_specific_configuration": {
}
}
2) Created 2 storage resources and added them as children to a coordinating resource. This would be the fast tier.
iadmin mkresc storageResc1 unixfilesystem 7b7f768cbf5c:/var/lib/irods/storageVault1
iadmin mkresc storageResc2 unixfilesystem 7b7f768cbf5c:/var/lib/irods/storageVault2
iadmin mkresc replResc replication
iadmin addchildtoresc replResc storageResc1
iadmin addchildtoresc replResc storageResc2
3) Created a storage resource. This would be slow tier.
iadmin mkresc tapeResc unixfilesystem 7b7f768cbf5c:/var/lib/irods/storageVaultTape
4) Created a tier group
imeta add -R replResc irods::storage_tiering::group example_group 0
imeta add -R tapeResc irods::storage_tiering::group example_group 1
5) Set tiering policy so files are copied to slow tier after 5 seconds
imeta add -R replResc irods::storage_tiering::time 5
6) Added a file to fast tier
iput -R replResc foo.txt
The problem is file is never copied to the slow tier (tapeResc) -- It should after 5 seconds passing. but it remains on fast tier (replResc)
Thanks for your help.
--
--
The Integrated Rule-Oriented Data System (iRODS) - https://irods.org [irods.org]
iROD-Chat: http://groups.google.com/group/iROD-Chat [groups.google.com]
---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/19642a8e-271f-4535-8be2-c62ed8f96972n%40googlegroups.com [groups.google.com].
--
--
The Integrated Rule-Oriented Data System (iRODS) - https://irods.org [irods.org]
iROD-Chat: http://groups.google.com/group/iROD-Chat [groups.google.com]
---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/141237e9-089d-42b0-ae40-1eb39d887343n%40googlegroups.com [groups.google.com].
--
--
The Integrated Rule-Oriented Data System (iRODS) -
https://irods.org [irods.org]
iROD-Chat:
http://groups.google.com/group/iROD-Chat [groups.google.com]
---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
irod-chat+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/d1066e67-3cbb-49a3-91bc-6894eb636e7bn%40googlegroups.com [groups.google.com].
iROD-Chat: http://groups.google.com/group/iROD-Chat
---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/b02fd0f10cfd49b8993a21147f1cb7ef%40sanger.ac.uk.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/d1066e67-3cbb-49a3-91bc-6894eb636e7bn%40googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/256d54cb-2774-4ccf-82b3-3a4a7cd048b8n%40googlegroups.com.