Transfers/ingest getting very slow

[Alfeu Uzai Tavares]

Hi all,

We have an instance of Archivematica 1.13.2, running as a storage for a DSpace repository. There is some automation in the system, starting and approving batches of 60 AIPs every hour. Up until now the system was working fine, but then the performance started to deteriorate in the last week. Currently our system has a total size of 785.1 GB, around 17k files indexed and 50k packages stored. Individual AIPs exported from DSpace are usually small, around 10Mb.

I needed to increase the timeouts ARCHIVEMATICA_MCPCLIENT_STORAGE_SERVICE_CLIENT_QUICK_TIMEOUT and ARCHIVEMATICA_MCPCLIENT_MCPCLIENT_STORAGE_SERVICE_CLIENT_QUICK_TIMEOUT to 120s. I also run the cleanup command daily, and cleaned up the /var/archivematica/sharedDirectory/tmp folder. This helped a bit at first, but after a while transfers are still taking a long time to start after approval, and longer to complete than before.

Any ideas on how to find the cause of this performance drop or other cleanup procedures that might help?