How to keep Dashboard clean and fast?

[Thiago Luna]

Hi, folks!

Is there any way to keep dashboard clean?

Every transfer executed stay on dashboard and every time I reload dashboard page (Transfer or Ingest), the Arhivematica run many sql selects to list all transfers and microservices made  and the time to reload all itens take so long.

Regards,

Thiago Luna

National Archives of Brazil

[Sara Allain]

Hi Thiago,

We recommend clearing out the Transfer and Ingest tabs periodically using the red delete icon. Here is documentation for clearing the Transfer tab and for clearing the Ingest tab. Note that these links are for Archivematica 1.10 but the functionality has been in place for a few versions now.

Regards,

Sara

--

Sara Allain, MI

Systems Archivist

Artefactual Systems, Inc.

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/42a86845-b809-494f-91ad-6bc362a32d30%40googlegroups.com.

[Thiago Luna]

Thank you, Sara, for your reply.

How can I find a transfer or ingest after clearing the dashboard?

Em quinta-feira, 26 de setembro de 2019 12:50:56 UTC-3, Sara @ Artefactual escreveu:

Hi Thiago,

We recommend clearing out the Transfer and Ingest tabs periodically using the red delete icon. Here is documentation for clearing the Transfer tab and for clearing the Ingest tab. Note that these links are for Archivematica 1.10 but the functionality has been in place for a few versions now.

Regards,

Sara

--

Sara Allain, MI

Systems Archivist

Artefactual Systems, Inc.

On Thu, Sep 26, 2019 at 8:40 AM Thiago Luna <thiag...@gmail.com> wrote:

Hi, folks!

Is there any way to keep dashboard clean?

Every transfer executed stay on dashboard and every time I reload dashboard page (Transfer or Ingest), the Arhivematica run many sql selects to list all transfers and microservices made  and the time to reload all itens take so long.

Regards,

Thiago Luna

National Archives of Brazil

--
You received this message because you are subscribed to the Google Groups "archivematica" group.

To unsubscribe from this group and stop receiving emails from it, send an email to archiv...@googlegroups.com.

[Sara Allain]

Once you have cleared a transfer or ingest from the dashboard, you can't bring it back to the dashboard. This is why the documentation says to make sure that the transfer/ingest is in a completed state (failed/rejected or completed/stored) before clearing it.

If you have cleared a transfer/ingest that was not complete (i.e. it was awaiting a decision), you can resolve those hanging decision points using mcp-rcp-cli, a command-line tool for interacting with Archivematica's MCP Client. There are instructions on how to do that here: Resolve Hanging Decisions. 

After they're cleared from the dashboard, you can still get information about the transfer/ingest by querying the MySQL database, though you likely need the UUID of the transfer/ingest in order to find the correct logs.

Regards,

Sara

--

Sara Allain, MI

Systems Archivist

Artefactual Systems, Inc.

To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/12ad6271-467d-4917-a247-ef47b3da0309%40googlegroups.com.

[Karl Goetz]

On Thu, 26 Sep 2019 08:50:15 -0700
Sara Allain <sal...@artefactual.com> wrote:

> Hi Thiago,
>
> We recommend clearing out the Transfer and Ingest tabs periodically using
> the red delete icon. Here is documentation for clearing the Transfer tab

> <https://www.archivematica.org/en/docs/archivematica-1.10/user-manual/transfer/transfer/#cleaning-up-the-transfer-dashboard>

> and for clearing the Ingest tab

> <https://www.archivematica.org/en/docs/archivematica-1.10/user-manual/ingest/ingest/#cleanup-ingest>.

> On Thu, Sep 26, 2019 at 8:40 AM Thiago Luna <thiag...@gmail.com> wrote:
>
> > Hi, folks!
> >
> > Is there any way to keep dashboard clean?

I can't find a reference at the moment but I remember there being a discussion of a cron job to do the cleanup automatically - can anyone
find a reference?
Being able to remove all jobs older than X weeks in a completed state would be beneficial to many groups.

thanks,

--
Karl Goetz
Technical Services Officer - eResearch, Information Technology Services
University of Tasmania & Tasmanian Partnership for Advanced Computing

Mail: University of Tasmania, Private Bag 69, Hobart, Tasmania 7001
Delivery: TT Flynn Street, Sandy Bay, Tasmania 7005



University of Tasmania Electronic Communications Policy (December, 2014).
This email is confidential, and is for the intended recipient only. Access, disclosure, copying, distribution, or reliance on any of it by anyone outside the intended recipient organisation is prohibited and may be a criminal offence. Please delete if obtained in error and email confirmation to the sender. The views expressed in this email are not necessarily the views of the University of Tasmania, unless clearly intended otherwise.

[Bonnie Gordon]

Hi all,

We have a cron job runs nightly to ingest materials (using the API) from a target folder, and the first thing it does is hide all completed transfers and ingests. The code is on GitHub: https://github.com/RockefellerArchiveCenter/scripts/blob/master/archivematica/startTransfer.py

Best,

Bonnie

[Ross Spencer]

Hi Thiago,

It looks like you've some great approaches suggested here. Using the API with a requests library in Python as Bonnie suggests is a great way to do this. The specific API commands are under 'hide' in the API docs.

Right now, if it is a single command you need, then we have a library that we're building out called amclient. It has the potential to be called directly as a command line tool, The tool can be imported as a library, or run as a module from the command line. 

There are a few commands that might interest you, or other readers of this post. 

    close-completed-transfers

                        Close all completed transfers.

    close-completed-ingests

                        Close all completed ingests.

    

    

    aips                Print all AIPs in the Storage Service.

    

    get-package-details

                        Retrieve details about a package in the storage

                        service with a given UUID.

So once you've installed amclient, you can make a call as follows to list the aips that you have stored: 

$ python /path/to/amclient.py aips --ss-user-name test --ss-url http://127.0.0.1:62081 test | python -m json.tool

or as a command-line call once installed:

$ amclient aips --ss-user-name test --ss-url http://127.0.0.1:62081 test | python -m json.tool

To clear transfers you would use your Archivematica credentials: 

$ amclient close-completed-transfers --am-user-name test --am-url http://127.0.0.1:62080 test 

Karl suggests a cron-task to clear transfers periodically. To clear transfers every seven days, a cron task might look as follows: 

* * 7 * * amclient close-completed-transfers --am-url http://127.0.0.1:62080 --am-user-name <api-user-name> <api-key> >/dev/null 2>&1

I am currently looking at an issue with running the amclient directly from `/usr/local/bin` which helps enable this use, so if you have an issue there too, I suggest taking a look at it as a module or standalone script (approach 1 above), but also if you try it, please let us know what the issue you're seeing is so we can address it. I'll log a GitHub issue shortly too once I can determine that it's not just my environment.

I hope this helps,

Best,

Ross

[Thiago Luna]

Hi, all!.

Thank you for your replies!

Sara, I understood. Once cleared a transfer/ingest tab from dashboard I can still get information by querying the MySQL database.

Karl and Bonnie, great idea to have a cron job.

And Ross, amclient is a very useful library! I will try to use it.

Regards,

Thiago Luna

National Archive of Brazil

[Ross Spencer]

I noticed this Archivematica API library from Benjamin Simonis on Github too: https://github.com/BenjaminSimonis/Archivematica-API-Handler I need to take a look but might also be of interest to others. 

Best,

Ross

[Tatiana Canelhas]

Hi group,

Is there a way to clear the hanging decitions in AM 1.13?

Thanks.

Tatiana Canelhas

[Tatiana Canelhas]

Answering my question, dev-tools is still working on 1.13.

:)