AtoM 2.4 new install Ubuntu 16.04 No Gearman worker available?

1,817 views
Skip to first unread message

moom...@gmail.com

unread,
Nov 6, 2017, 6:01:20 AM11/6/17
to AtoM Users
Hi All

I am new to AtoM and have just installed 2.4 as per the instructions.

The site is up, but when trying an import we get an error 500. In the nginx error log we get - [error] 1353#1353: *1 FastCGI sent in stderr: "PHP message: No Gearman worker available that can handle the job arFileImportJob" 

When I run - sudo php symfony jobs:worker

2017-11-06 02:52:55 > New ability: arFindingAidJob
2017-11-06 02:52:55 > New ability: arInheritRightsJob
2017-11-06 02:52:55 > New ability: arObjectMoveJob
2017-11-06 02:52:55 > New ability: arInformationObjectCsvExportJob
2017-11-06 02:52:57 > Ability not defined: qtSwordPluginWorker. Please ensure the job is in the lib/task/job directory or that the plugin is enabled.
2017-11-06 02:52:57 > New ability: arUpdatePublicationStatusJob
2017-11-06 02:52:57 > New ability: arFileImportJob
2017-11-06 02:52:57 > New ability: arInformationObjectXmlExportJob
2017-11-06 02:52:57 > New ability: arXmlExportSingleFileJob
2017-11-06 02:52:57 > New ability: arGenerateReportJob
2017-11-06 02:52:57 > New ability: arActorCsvExportJob
2017-11-06 02:52:57 > New ability: arActorXmlExportJob
2017-11-06 02:52:57 > New ability: arRepositoryCsvExportJob
2017-11-06 02:52:57 > Running worker...
2017-11-06 02:52:57 > PID 2274

and when I check to see if it is running I can see:
 ps -A
2274 pts/5    00:00:00 php

There is nothing in the gearman-job-server/gearman.log

What can I do to get gearman working with AtoM or test where the issue is?
Any help appreciated.

Thanks

Dan Gillean

unread,
Nov 6, 2017, 11:44:16 AM11/6/17
to ICA-AtoM Users
Hi Jordan, 

Did you follow all the instructions listed here to set up Gearman?
Make sure once you've followed the installation instructions that the qtSwordPlugin is enabled under Admin > Plugins. You can also follow the instructions on the page above to try restarting the atom-worker, and/or to check the status. On Ubuntu 16.04: 
  • sudo systemctl enable atom-worker # Enables the worker (on boot) 
  • sudo systemctl start atom-worker # Starts the worker 
  • sudo systemctl stop atom-worker # Stops the worker 
  • sudo systemctl restart atom-worker # Restarts the workers 
  • sudo systemctl status atom-worker # Obtains current status
I'm not sure if this is what you tried already but you can also take a look at the logs with the following command: 
  • sudo journalctl -f -u atom-worker
You could also try reloading the configuration file you should have created at /usr/lib/systemd/system/atom-worker.service (as per the 16.04 instructions linked above), to make sure it is being read correctly. You might also want to restart PHP-FPM and memcached (since AtoM jobs are stored there) and clear your application cache as well. Try: 
  • sudo systemctl daemon-reload
  • sudo systemctl restart atom-worker
  • sudo systemctl restart php7.0-fpm
  • sudo systemctl restart memcached
  • php symfony cc
Let us know if that helps! If not, let us know more information so we can try to help you further, such as what version of PHP you have installed, whether you made any changes to the default 16.04 installation instructions, etc. Good luck! 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/639edab4-dc06-4fcc-9ebf-34508d275ebf%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

moom...@gmail.com

unread,
Nov 7, 2017, 6:11:20 AM11/7/17
to AtoM Users
Hi Dan

Thanks for that. Its now up and working. I did not realize that there were more instructions to get the Gearman worker setup. I was following https://www.accesstomemory.org/en/docs/2.4/admin-manual/installation/linux/ubuntu-xenial/ and just left it at the end there. I am now going through moving the site to HTTPS and securing what I can on the box via firewall and config settings.

Thanks for the help.

Kind Regards
Jordan
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.

tat...@gmail.com

unread,
Dec 12, 2017, 1:35:10 PM12/12/17
to AtoM Users
Hi Dan, 

can you help me with this error:
2017/12/12 16:08:55 [error] 1078#1078: *6938 FastCGI sent in stderr: "PHP message: No Gearman worker available that can handle the job qtSwordPluginWorker" while reading response header from upstream, client: 10.9.16.45, server: _, request: "POST //sword/deposit/aniversario-de-25-anos-do-tcdf HTTP/1.1", upstream: "fastcgi://unix:/run/php7.0-fpm.atom.sock:", host: "10.9.16.44"

Running 

sudo php /usr/share/nginx/atom/symfony jobs:worker

I get:

2017-12-12 10:27:59 > New ability: arFindingAidJob
2017-12-12 10:27:59 > New ability: arInheritRightsJob
2017-12-12 10:27:59 > New ability: arObjectMoveJob
2017-12-12 10:27:59 > New ability: arInformationObjectCsvExportJob
2017-12-12 10:27:59 > New ability: qtSwordPluginWorker
2017-12-12 10:27:59 > New ability: arUpdatePublicationStatusJob
2017-12-12 10:27:59 > New ability: arFileImportJob
2017-12-12 10:27:59 > New ability: arInformationObjectXmlExportJob
2017-12-12 10:27:59 > New ability: arXmlExportSingleFileJob
2017-12-12 10:27:59 > New ability: arGenerateReportJob
2017-12-12 10:27:59 > New ability: arActorCsvExportJob
2017-12-12 10:27:59 > New ability: arActorXmlExportJob
2017-12-12 10:27:59 > New ability: arRepositoryCsvExportJob
2017-12-12 10:27:59 > Running worker...
2017-12-12 10:27:59 > PID 29127

Running

 
sudo journalctl -f -u atom-worker

I get:

-- Logs begin at Ter 2017-12-05 08:39:01 -02. --
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arUpdatePublicationStatusJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arFileImportJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arInformationObjectXmlExportJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arXmlExportSingleFileJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arGenerateReportJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arActorCsvExportJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arActorXmlExportJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > New ability: arRepositoryCsvExportJob
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > Running worker...
Dez 12 14:47:17 acervo php[27689]: 2017-12-12 08:47:17 > PID 27689

And I already did:

sudo systemctl restart php7.0-fpm
sudo systemctl daemon
-reload
sudo systemctl restart atom
-
worker
sudo systemctl restart memcached
php symfony cc

What else I can do?

Thanks,
Tatiana Canelhas

Dan Gillean

unread,
Dec 12, 2017, 1:53:13 PM12/12/17
to ICA-AtoM Users
Hi Tatiana, 

What are you trying to do that is producing this error?

It sounds like you are trying all of the right things. I would ensure that the qtSwordPlugin is enabled In Admin  > Plugins first. You can also try killing all running jobs (in case there is an old job stuck that is holding up the queue and causing the issue) with the following command: 
  • php symfony jobs:clear
You can double-check the atom-worker status with the following command (on Ubuntu 16.04):
  • sudo systemctl status atom-worker
Other than that, I'm not sure. Either you have found a bug (in which case please provide more information so we can try to reproduce!), or perhaps some of the job scheduler dependencies are not installed or properly configured. 

Regards, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Message has been deleted
Message has been deleted

Dan Gillean

unread,
Dec 12, 2017, 3:15:28 PM12/12/17
to ICA-AtoM Users
Hi Tatiana, 

First: you have inadvertently shared your AtoM admin user and password in your first reply - I have delete the message from the online forum, but it will be sitting in the mailbox of anyone who receives email updates. I strongly recommend you change your passwords immediately. 

From the second message it sounds like you may have some corrupt data - at least one description that is missing a publication status in the database. One of our developers has previously shared some SQL to help resolve this - see: 
Be sure to swap in your object ID returned in the error message (1938) for the one used in the example query (217945)!

There may be other data corruption issues - you might end up playing chase for a bit as you resolve one error and discover others. There are further suggestions on resolving data corruption issues here: 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

On Tue, Dec 12, 2017 at 2:27 PM, Tatiana <tat...@gmail.com> wrote:
Dan, after clearing the jobs, now my nginx is showing:

2017/12/12 17:23:10 [error] 1078#1078: *7029 FastCGI sent in stderr: "PHP message: No publication status set for information object id: 1938" while reading response header from upstream, client: 10.9.23.106, server: _, request: "GET /index.php/aniversario-de-25-anos-do-tcdf-1-tif HTTP/1.1", upstream: "fastcgi://unix:/run/php7.0-fpm.atom.sock:", host: "10.9.16.44", referrer: "http://10.9.16.44/index.php/aniversario-de-25-anos-do-tcdf"

I am trying to submit a dip with two objects, and only one is created as item, but no object is showed.



On Tue, Dec 12, 2017 at 5:02 PM, Tatiana <tat...@gmail.com> wrote:
Dan, all jobs were clear, qtSwordPlugin was already enabled and I ran the worker code:

● atom-worker.service - AtoM worker
   Loaded: loaded (/usr/lib/systemd/system/atom-worker.service; enabled; vendor preset: enabled)
   Active: active (running) since Ter 2017-12-12 16:29:02 -02; 27min ago
  Process: 29152 ExecStop=/bin/kill -s TERM $MAINPID (code=exited, status=0/SUCCESS)
 Main PID: 29158 (php)
    Tasks: 1
   Memory: 14.7M
      CPU: 574ms
   CGroup: /system.slice/atom-worker.service
           └─29158 /usr/bin/php -d memory_limit=-1 -d error_reporting=E_ALL symfony jobs:worker

Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arUpdatePublicationStatusJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arFileImportJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arInformationObjectXmlExportJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arXmlExportSingleFileJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arGenerateReportJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arActorCsvExportJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arActorXmlExportJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > New ability: arRepositoryCsvExportJob
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > Running worker...
Dez 12 16:29:02 acervo php[29158]: 2017-12-12 10:29:02 > PID 29158


I was trying to Upload a DIP.

I got the following error from the dashboard:

Command: upload-qubit_v0.0 --url="http://10.9.16.44/" --email="archiv...@tc.df.gov.br" --password="4Np5cNN7" --rsync-target="archivematica@10.9.16.44:/tmp" --version="2" --debug --uuid="e99046ce-9994-42ea-b3c1-da0d57a3775d"

STDERR

[uploadDIP] Response code not expected
So I looked at nginx log error from atom.


Any ideias?

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

Tatiana

unread,
Dec 12, 2017, 3:36:47 PM12/12/17
to ica-ato...@googlegroups.com
Oh My god. Thanks dan. My mistake.

To post to this group, send email to ica-ato...@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "AtoM Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ica-atom-users/eYSP6r9zyeM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ica-atom-users+unsubscribe@googlegroups.com.

To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

Tatiana

unread,
Dec 13, 2017, 11:21:44 AM12/13/17
to ica-ato...@googlegroups.com
Dan, I think it's a bug problem.

The steps I am doing are:
  1. archivematica dashboard: transfer a package with 2 tif files (2 images)
    1. Aniversario_de_25_anos_do_TCDF_1.tif
    2. Aniversario_de_25_anos_do_TCDF_2.tif
  2. send them to backlog
  3. arrange them to a new directory and I select a level for this directory and for the 2 files

  4. Create a SIP
  5. Go through all the microservices until dip upload
  6. select the slug to where i want to send the files
  7. archivematica sets the level in atom according to the one i chose in archivematica (NICE)
  8. And now i suppose archivematica should send the 2 tif files to be the children of the directory i chose.
  9. It creates the first one (but only the description - without the digital object), but not the second, and there's no error in the upload dip
  10. in the nginx log in atom:
2017/12/13 14:04:59 [error] 1078#1078: *7137 FastCGI sent in stderr: "PHP message: No publication status set for information object id: 1947" while reading response header from upstream, client: 10.9.23.106, server: _, request: "GET /index.php/aniversario-de-25-anos-do-tcdf-1-tif HTTP/1.1", upstream: "fastcgi://unix:/run/php7.0-fpm.atom.sock:", host: "10.9.16.44", referrer: "http://10.9.16.44/index.php/aniversario-de-25-anos-do-tcdf"
 
Selecting this id in the status table, indeed, there´s no status the new file created by archivematica.

Sarah Romkey

unread,
Dec 13, 2017, 1:25:03 PM12/13/17
to AtoM Users

Hi Tatiana,

Could you please include some details about the structure you've assigned in the Archivematica dashboard? Did you create a top level directory and assign a level of description for that, or only to the child objects? We'll do some testing to try to re-create your error but I need a few more details.

Another question, are you entering any metadata in the Archivematica UI? (e.g. Dublin Core metadata for the SIP).

Thanks!

-Sarah
To post to this group, send email to ica-atom-users@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "AtoM Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ica-atom-users/eYSP6r9zyeM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.

Tatiana

unread,
Dec 13, 2017, 3:25:26 PM12/13/17
to ica-ato...@googlegroups.com
Hi Sarah,

It was not a top level description the directory I created in Archivematica.
In Atom, I have a hierarchical tree, and I am trying to upload the last child, so the items will be placed there.
I am testing first without the metadata.

My structuredMap:

<mets:structMap ID="structMap_1" LABEL="Archivematica default" TYPE="physical">
<mets:div LABEL="aniversario-de-25-anos-do-tcdf-6b2df694-decd-4f34-ab9b-5c865e31ea27" TYPE="Directory">
<mets:div LABEL="objects" TYPE="Directory">
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_1-4d4b0768-c9d0-40c7-9ee9-a80c68da2627.tif" TYPE="Item">
<mets:fptr FILEID="file-4d4b0768-c9d0-40c7-9ee9-a80c68da2627"/>
</mets:div>
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_1.tif" TYPE="Item">
<mets:fptr FILEID="file-f8564715-d544-4a43-832f-cf9916c5f6e6"/>
</mets:div>
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_2-e5c614b8-550b-4aeb-94b7-0657b15194e9.tif" TYPE="Item">
<mets:fptr FILEID="file-e5c614b8-550b-4aeb-94b7-0657b15194e9"/>
</mets:div>
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_2.tif" TYPE="Item">
<mets:fptr FILEID="file-3165a4f5-e5a8-419b-8a0d-f5e5f7ac8e6b"/>
</mets:div>
<mets:div LABEL="submissionDocumentation" TYPE="Directory">
<mets:div LABEL="transfer-aniversario_25-a103b4fb-b77d-495d-9bc8-c7793f463ec2" TYPE="Directory">
<mets:div LABEL="METS.xml" TYPE="Item">
<mets:fptr FILEID="file-9a306a4e-9343-4ecf-8fd4-1dcdc9c1d418"/>
</mets:div>
</mets:div>
</mets:div>
</mets:div>
</mets:div>
</mets:structMap>
<mets:structMap ID="structMap_d27dc5fa-a6cf-4501-95f1-8f6ec9c91cbd" LABEL="Hierarchical" TYPE="logical">
<mets:div LABEL="aniversario-de-25-anos-do-tcdf-6b2df694-decd-4f34-ab9b-5c865e31ea27">
<mets:div LABEL="objects" TYPE="Dossiê">
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_1-4d4b0768-c9d0-40c7-9ee9-a80c68da2627.tif">
<mets:fptr FILEID="file-4d4b0768-c9d0-40c7-9ee9-a80c68da2627"/>
</mets:div>
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_1.tif">
<mets:fptr FILEID="file-f8564715-d544-4a43-832f-cf9916c5f6e6"/>
</mets:div>
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_2-e5c614b8-550b-4aeb-94b7-0657b15194e9.tif">
<mets:fptr FILEID="file-e5c614b8-550b-4aeb-94b7-0657b15194e9"/>
</mets:div>
<mets:div LABEL="Aniversario_de_25_anos_do_TCDF_2.tif" TYPE="Item">
<mets:fptr FILEID="file-3165a4f5-e5a8-419b-8a0d-f5e5f7ac8e6b"/>
</mets:div>
</mets:div>
</mets:div>
</mets:structMap>
</mets:mets>

Thanks,
Tatiana Canelhas

To post to this group, send email to ica-ato...@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "AtoM Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ica-atom-users/eYSP6r9zyeM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "AtoM Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ica-atom-users/eYSP6r9zyeM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

tat...@gmail.com

unread,
Jan 15, 2018, 12:28:55 PM1/15/18
to AtoM Users
Hi Dan,

trying to run php symfony jobs:clear i the a messa error:

Unable to open the log file "/usr/share/nginx/atom/log/qubit_cli.log" for writing.
[exception]   500 | Internal Server Error | sfFileException[message]     Unable to open the log file "/usr/share/nginx/atom/log/qubit_cli.log" for writing.[stack trace]


I already did:

sudo chown -R www-data:www-data /usr/share/nginx/atom

What else can i do?


Dan Gillean

unread,
Jan 15, 2018, 3:47:02 PM1/15/18
to ICA-AtoM Users
Huh! 

Well, you can first try ensuring you are running the command from the root AtoM directory - /usr/share/nginx/atom - though it shouldn't matter, since you are specifying the target directory. 

You could try removing all other permissions, like so:
  • sudo chmod o= /usr/share/nginx/atom
You can check your configuration file for the atom-worker, to ensure that  user and group are in fact www-data

You can try reloading systemd (as described in the last command shown in the image above), as well as restarting the atom-worker, and clearing all caches. ​

You could also try running the command explicitly as the www-data user: 
  • sudo -u www-data php symfony jobs:clear
Let me know if any of that helps! 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

Sarah Romkey

unread,
Jan 15, 2018, 5:14:15 PM1/15/18
to AtoM Users
Hi Tatiana,

I realized that I never followed up on trying to reproduce the bug from the Archivematica side. I created a DIP with a structMap basically identical to yours and couldn't reproduce your error, so I don't think it's related to the arrangement function in Archivematica being used.

Cheers,

Sarah
Reply all
Reply to author
Forward
0 new messages