Bug report: error finishing job with long title

11 views
Skip to first unread message

Pritchett, James

unread,
Apr 10, 2014, 11:14:19 AM4/10/14
to daisy-pip...@googlegroups.com
I'm running a large number of books through dp2 now, so I may be finding a number of bugs.  Let me know if these should be posted elsewhere.

I had a job with a very long title (and three instances of dc:identifier, which I need to fix on our end). After completing the daisy202-to-epub3 conversion, dp2 threw a java exception (details below).  This caused the job to hang at "RUNNING" status, so my client job just sat there forever waiting for it to complete.  Looks like an exception handler needs to be added in there.

James

==============
2014-04-09 17:25:31,698 [DEBUG] org.daisy.pipeline.job.ResultSet - Adding result JobResult [#=output/us-rfbd.EP-MN486us-rfbd.EP-MN486us-rfbd.EP-MN486%20-%20Major%20Problems%20in%20African-American%20History,%20Volume%20II%20From%20Freedom%20to%20Freedom%20Now,%201865-1990s%20Major%20Problems%20in%20African-American%20History,%20Volume%20II%20From%20Freedom%20to%20Freedom%20Now,%201865-1990s.epub path='file:/C:/Documents%20and%20Settings/jpritchett/Application%20Data/DAISY%20Pipeline%202/jobs/2d9dc935-99bb-4d64-a553-90507448c836/output/output/us-rfbd.EP-MN486us-rfbd.EP-MN486us-rfbd.EP-MN486%20-%20Major%20Problems%20in%20African-American%20History,%20Volume%20II%20From%20Freedom%20to%20Freedom%20Now,%201865-1990s%20Major%20Problems%20in%20African-American%20History,%20Volume%20II%20From%20Freedom%20to%20Freedom%20Now,%201865-1990s.epub']
2014-04-09 17:25:31,698 [INFO ] org.daisy.pipeline.job.Job - Changing job status to: DONE
2014-04-09 17:25:31,698 [DEBUG] org.daisy.pipeline.push.Poster - Status changed 2d9dc935-99bb-4d64-a553-90507448c836->DONE
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - load script XProcScript[name=DAISY 2.02 to EPUB3]
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - load script XProcScript[name=DAISY 2.02 to EPUB3]
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - Post loading jobcontext
2014-04-09 17:25:31,698 [DEBUG] o.d.pipeline.job.JobContextFactory - configuring object org.daisy.pipeline.persistence.jobs.PersistentJobContext@1df52c5
2014-04-09 17:25:31,698 [DEBUG] o.d.pipeline.job.JobContextFactory - configuring object org.daisy.pipeline.persistence.jobs.PersistentJobContext@1df52c5
2014-04-09 17:25:31,698 [INFO ] o.d.p.persistence.jobs.PersistentJob - Changing Status:DONE
2014-04-09 17:25:31,698 [DEBUG] o.d.p.persistence.jobs.PersistentJob - Updating object
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - load script XProcScript[name=DAISY 2.02 to EPUB3]
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - load script XProcScript[name=DAISY 2.02 to EPUB3]
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - Post loading jobcontext
2014-04-09 17:25:31,698 [DEBUG] o.d.pipeline.job.JobContextFactory - configuring object org.daisy.pipeline.persistence.jobs.PersistentJobContext@d72e4d
2014-04-09 17:25:31,698 [DEBUG] o.d.p.p.jobs.PersistentJobContext - load script XProcScript[name=DAISY 2.02 to EPUB3]
2014-04-09 17:25:31,761 [ERROR] org.daisy.pipeline.job.Job - job finished with error state
javax.persistence.RollbackException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.3.2.v20111125-r10461): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: java.sql.SQLDataException: A truncation error was encountered trying to shrink VARCHAR 'output/us-rfbd.EP-MN486us-rfbd.EP-MN486us-rfbd.EP-MN486%20-%&' to length 255.
Error Code: 20000
Call: INSERT INTO job_option_results (MEDIATYPE, OPTIONNAME, PATH, idx, job_id) VALUES (?, ?, ?, ?, ?)
bind => [5 parameters bound]
Query: InsertObjectQuery(org.daisy.pipeline.persistence.jobs.PersistentOptionResult@155c49f)
at org.eclipse.persistence.internal.jpa.transaction.EntityTransactionImpl.commitInternal(EntityTransactionImpl.java:102) ~[na:na]
at org.eclipse.persistence.internal.jpa.transaction.EntityTransactionImpl.commit(EntityTransactionImpl.java:63) ~[na:na]
at org.daisy.pipeline.persistence.Database.updateObject(Database.java:44) ~[na:na]
at org.daisy.pipeline.persistence.jobs.PersistentJob.onStatusChanged(PersistentJob.java:149) ~[na:na]
at org.daisy.pipeline.job.Job.changeStatus(Job.java:164) ~[na:na]
at org.daisy.pipeline.job.Job.run(Job.java:197) ~[na:na]
at org.daisy.pipeline.job.DefaultJobExecutionService$1.run(DefaultJobExecutionService.java:65) ~[na:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_51]


--

James Pritchett

Leader, Process Redesign and Analysis

_________________________________________

Learning Ally™

formerly Recording for the Blind & Dyslexic®

20 Roszel Road | Princeton, NJ 08540

Phone: 609.243.7608

Fax:  (609) 520-7996

jprit...@LearningAlly.org

www.LearningAlly.org

Pritchett, James

unread,
Apr 10, 2014, 11:17:04 AM4/10/14
to daisy-pip...@googlegroups.com
... and a feature request:  daisy202-to-epub3 should really truncate very long titles when creating output files.  I'd think that 50-75 characters of the title would be more than enough.

James

Javier Asensio

unread,
Apr 10, 2014, 1:14:17 PM4/10/14
to daisy-pip...@googlegroups.com

Dear James,

I'll double check tomorrow as I'm on the road but this issue will be solved in the next release as it was addressed not do long ago. If it wasn't addressed it will be ;). If you need it to be solved asap I'll send you a patched version of the pipeline.

Thanks a million

--
You received this message because you are subscribed to the Google Groups "DAISY Pipeline Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to daisy-pipeline-...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Pritchett, James

unread,
Apr 10, 2014, 1:30:30 PM4/10/14
to daisy-pip...@googlegroups.com
Thanks, Javier.  FYI, I'm out of the office for the next two weeks, so you don't have to rush anything!

James

Jostein Austvik Jacobsen

unread,
Apr 11, 2014, 3:24:17 PM4/11/14
to daisy-pip...@googlegroups.com
Regarding the feature request: In the next release, I'm planning to use the identifier for the filename, with an optional option that allows you to override it with a custom filename. That way we won't have to truncate the filenames.


Jostein

Pritchett, James

unread,
Apr 30, 2014, 4:38:19 PM4/30/14
to daisy-pip...@googlegroups.com
Hi Javier,

I could use that patched version of the pipeline to fix this bug.  I am about ready to run some more test batches of books.

Thanks!

James


On Thu, Apr 10, 2014 at 1:14 PM, Javier Asensio <capitan...@gmail.com> wrote:
Reply all
Reply to author
Forward
0 new messages