Error uploading pdf image

[jesus san miguel]

Hi all,

I have an error in two different servers running AtoM 2.5.3-172 when I upload a PDF image through the GUI.

The error ends being NULL digital_object.path value:

This is from nginx.log:

2020/10/30 18:02:48 [error] 928#928: *577 FastCGI sent in stderr: "PHP message: Unable to execute INSERT statement. [wrapped: SQLSTATE[HY000]: General error: 1364 Field 'name' doesn't have a default value]" while reading response header from upstream, client: 95.120.153.214, server: _, request: "POST /index.php/testing/object/addDigitalObject HTTP/1.1", upstream: "fastcgi://unix:/run/php7.2-fpm.atom.sock:", host: "188.164.195.165", referrer: "http://188.164.195.165/index.php/testing/object/addDigitalObject"

And this is the database insert log:

2020-10-30T18:02:48.621153Z     4 Query INSERT INTO object (`CLASS_NAME`,`CREATED_AT`,`UPDATED_AT`) VALUES ('QubitDigitalObject','2020-10-30 11:02:48','2020-10-30 11:02:48')

2020-10-30T18:02:48.621513Z     4 Query INSERT INTO digital_object (`ID`,`OBJECT_ID`,`PATH`,`PARENT_ID`) VALUES (223394,223393,'',223392)

2020-10-30T18:02:48.622005Z     4 Query ROLLBACK

If I upload the digital object through the cli, it works as expected:

root@ubuntu18:/usr/share/nginx/atom# php symfony digitalobject:load --path="/root/" --index /root/niatiros.csv

>> digital-object Load digital objects from /root/niatiros.csv...

(Oct 30, 09:41:48 AM) Loading 'niatiros.pdf' (1 of 1 remaining)

>> digital-object Successfully Loaded 1 digital objects.

root@ubuntu18:/usr/share/nginx/atom# 

Best,

Jesus.

[José Raddaoui]

Hi Jesús,

This is probably caused by having STRICT_TRANS_TABLES enabled in MySQL's sql_mode. We recently changed this section in the documentation (here for 2.5) to reflect the need of removing it and we have this ticket to support it in future versions, where I've added a note to this post.

Thanks for letting us know about this issue.

Best regards,

Radda.

[José Raddaoui]

Hi again Jesús,

Thinking it through, in a GUI upload the path shouldn't be null and, additionally, we addressed that issue in https://projects.artefactual.com/issues/13144. And, reading the error again, it looks like it's actually complaining about the 'name' column instead of the path. Not sure what could be causing an empty name in GUI uploads, maybe it's related to encoding, web server permissions, or the file path in the CSV.

Bests,

Radda.

[jesus san miguel]

Hi Radda,

Let me exclude a bunch of maybes: If it is a JPG instead of a PDF, the
upload works smooth as silk, so, lets discard encoding, web server
permissions and the CSV file path, since this is a GUI upload. I tried
tweaking policies in imagemagik conf file, but so far I'm concerned
about the SQL insert failing. Why would path variable be empty when I
upload a PDF and have a value if I upload a JPG? Aren't they uploaded
in the same folder structure inside ./uploads/r/...?

> --
> You received this message because you are subscribed to a topic in the Google Groups "AtoM Users" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/topic/ica-atom-users/PMB-fHLDLhQ/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to ica-atom-user...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/6b7a8866-0206-4785-a3f6-f49c06ca5270n%40googlegroups.com.

[jesus san miguel]

Perhaps this might be of use to diagnose the error...

On Mon, Nov 2, 2020 at 5:48 PM José Raddaoui <jrad...@artefactual.com> wrote:
>

[José Raddaoui]

Hi Jesús,

It looks like the issue happens with the digital object name, not the path and, seeing those logs, maybe it's the normal behavior in the PDF compound children (see setting docs). So it could be STRICT_TRANS_TABLE enabled in the sql_mode what is actually making it appear as an error instead of a warning. I'll give it a try locally and let you know how it goes.

Bests.

[jesus san miguel]

Yes, you were right on the spot! Removing STRICT_TRANS_TABLE in
/etc/mysql/conf.d/mysql.cnf did finally the trick.

Don't forget enable read on /etc/ImageMagick-6/policy.xml

<policy domain="coder" rights="read" pattern="PDF" />

Thanks!

> To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/37188e05-e516-4b73-ace7-78db8232dec0n%40googlegroups.com.

[José Raddaoui]

Good news Jesús, thanks for reporting back!

[Danilo Muñoz]

Hi everyone, have a good day.

i have the same problem, i change my mysql.conf and policy.xml but the site dont found the thumbnails

my site

the process

php symfony csv:import /home/administrator/AFA_RS-afa.csv
php symfony search:populate
php symfony cc
service nginx restart
service php7.4-fpm restart

the results:

pdf ok 

preview lost

jpg created

the strange thing? does not show any error

I hope you can help me

best,

Danilo

pd: I also tried to regenerate, but it didn't help either. 

sudo -u www-data php symfony digitalobject:regen-derivatives

[Dan Gillean]

Hi Danilo, 

Apologies in advance for the repetition, but I will walk through the normal steps we recommend to resolve this issue below in order, just to double-check that you have completed all the suggested steps in the correct sequence. Based on the commands that you shared in your post, I am assuming you have a 2.7 installation - if not, be sure to check the correct version of the user manual for your current AtoM version, as some instructions (like how to restart PHP-FPM) may be different.  

If I am understanding correctly, you are saying you have already made the recommended change in the Ghostscript policy.xml file described in this thread?

• https://groups.google.com/d/msg/ica-atom-users/AwNUifxWsS4/BvfV6x9uBQAJ

And you have double-checked the SQL modes applied, per these instructions? 

• https://www.accesstomemory.org/docs/latest/admin-manual/maintenance/common-atom-queries/#check-server-sql-modes

In AtoM 2.7, the only SQLmodes that should be set are: ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION. If they are not, then the link above should tell you how to change them. 

If yes - did you remember to restart MySQL after making SQL mode changes?

• sudo systemctl restart mysql

Let's also make sure that the filesystem permissions are set properly as AtoM expects: 

• sudo chown -R www-data:www-data /usr/share/nginx/atom
  
• See: https://www.accesstomemory.org/docs/latest/admin-manual/installation/ubuntu/#filesystem-permissions

If you have checked and confirmed that both of the files above are updated correctly and that the permissions are properly set, then now you could try regenerating derivatives. We can run it more quickly by limiting it to just text files (i.e. PDFs), like so: 

• php symfony digitalobject:regen-derivatives --media-type="text"
  
• See: https://www.accesstomemory.org/docs/latest/admin-manual/maintenance/cli-tools/#regenerating-derivatives

After that and BEFORE testing would be the time to clear the application cache and restart PHP-FPM - it's possible if you test before doing this that you are still seeing an older cached version of the page: 

• php symfony cc
• https://www.accesstomemory.org/docs/latest/admin-manual/maintenance/clear-cache/
• sudo systemctl restart php7.4-fpm
• https://www.accesstomemory.org/docs/latest/admin-manual/maintenance/troubleshooting/#restarting-php-fpm
  

Remember as well that your web browser also has its own cache, so you might want to clear this before re-testing, or test in a private / incognito browser window, where the cache is typically disabled by default. 

If that still doesn't work, then now would be a good time for us to gather additional information. 

• What is the full version number shown in Admin > Settings?
• Have you upgraded recently? If yes, did you follow Option 1 (download the tarball from our website) or Option 2 (install from our GitHub code repository)?
•  Does your site have any local customizations or code changes in place, including a custom theme plugin?
• Is this affecting ALL PDFs, or just some of them? 
• Do you have any PREMIS rights applied to the affected descriptions?
• Anything else we should know about your installation?

Hopefully with more information, we can provide further suggestions. 

Cheers, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

he / him

You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/a28de5a7-f87b-4ee9-b263-10fc227a698dn%40googlegroups.com.

[Danilo Muñoz]

Thank you very much for your great help Dan. In the end, I rebuilt the server and installed the GIT version, corrected the policy and everything worked perfectly. http://archivodeartesuc.cl/index.php/musica