Build failure with latest trunk

[Sebastian Humenda]

Hi Joel,

with latest trunk, I get errors on my machine, where it worked with the stable
release before. I use
ant -DuseExternalJarsOnLinux=true
and corrected /usr/share/java/saxonb.jar to /usr/share/java/saxon.jar.

Can you see what is going wrong there?

Thanks!
Sebastian
===
Buildfile: /home/streicher/daten/quellen/debian/brailleutils/build.xml

detectOS:

buildZip:
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/dist

detectOS:

debianProperties:

setClasspath:

createDistDir:
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/dist

buildCoreJar:
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp
[javac] Compiling 119 source files to /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp
[javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5
[javac] 1 warning
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/paper/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/tools/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/table/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/embosser/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/facade/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/printing/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/ui/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/factory/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/braille/pef/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/validator/package-info.class
[javac] Creating empty /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp/org/daisy/cli/package-info.class
[jar] Building jar: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/dist/brailleUtils-core.jar
[jar] Building jar: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/dist/brailleUtils-ui.jar
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/build.temp

buildCatalogJar:
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/catalog-build.temp
[javac] Compiling 58 source files to /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/catalog-build.temp
[javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5
[javac] 1 warning
[jar] Building jar: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/dist/brailleUtils-catalog.jar
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/catalog-build.temp

BUILD FAILED
/home/streicher/daten/quellen/debian/brailleutils/build.xml:356: /home/streicher/daten/quellen/debian/brailleutils/lib does not exist.

Total time: 11 seconds
--
Web: http://www.crustulus.de | Blog (eng / deu): http://www.crustulus.de/blog
Freies Latein-Deutsch-Wörterbuch: http://www.crustulus.de/freedict.de.html
FreeDict: Free multilingual dictionary databases - http://www.freedict.org

[Sebastian Humenda]

Hello again,

the simplest fix is to create the directory, but I don't feel like that is a
good thing :-).

Another thing is that all tests seem to fail and I don't know why. The log
output is attached.

Many thanks for your time!

[zip] Building zip: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/dist/brailleUtils-snapshot.zip

debianProperties:

setClasspath:

buildJavadoc:
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/docs/javadoc
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/docs/javadoc
[javadoc] Generating Javadoc
[javadoc] Javadoc execution
[javadoc] Loading source files for package org.daisy.braille...
[javadoc] Loading source files for package org.daisy.braille.embosser...
[javadoc] Loading source files for package org.daisy.braille.facade...
[javadoc] Loading source files for package org.daisy.braille.pef...
[javadoc] Loading source files for package org.daisy.braille.table...
[javadoc] Loading source files for package org.daisy.braille.tools...
[javadoc] Loading source files for package org.daisy.braille.ui...
[javadoc] Loading source files for package org.daisy.cli...
[javadoc] Loading source files for package org.daisy.factory...
[javadoc] Loading source files for package org.daisy.paper...
[javadoc] Loading source files for package org.daisy.printing...
[javadoc] Loading source files for package org.daisy.validator...
[javadoc] Constructing Javadoc information...
[javadoc] Standard Doclet version 1.7.0_25
[javadoc] Building tree for all the packages and classes...
[javadoc] /home/streicher/daten/quellen/debian/brailleutils/src/org/daisy/braille/pef/TextInputDetector.java:70: warning - @return tag has no arguments.
[javadoc] /home/streicher/daten/quellen/debian/brailleutils/src/org/daisy/braille/table/AbstractConfigurableTableProvider.java:55: warning - @return tag has no arguments.
[javadoc] Building index for all the packages and classes...
[javadoc] Building index for all classes...
[javadoc] Generating /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/docs/javadoc/help-doc.html...
[javadoc] 2 warnings

buildAndTest:
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-report
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-report
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-build.temp
[javac] Compiling 30 source files to /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-build.temp

[javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5
[javac] 1 warning

[jar] Building jar: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test.jar
[mkdir] Created dir: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-report.temp
[junit] Test com_indexbraille.IndexV2EmbosserTest FAILED
[junit] Test org.daisy.braille.pef.PEFFileMergerTest FAILED
[junit] Test org.daisy.braille.pef.PEFFileSplitterTest FAILED
[junitreport] Processing /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-report/TESTS-TestSuites.xml to /tmp/null444413583
[junitreport] Loading stylesheet jar:file:/usr/share/ant/lib/ant-junit.jar!/org/apache/tools/ant/taskdefs/optional/junit/xsl/junit-frames.xsl
[junitreport] Transform time: 2403ms
[junitreport] Deleting: /tmp/null444413583
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-report.temp
[delete] Deleting directory /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test-build.temp
[delete] Deleting: /home/streicher/daten/quellen/debian/brailleutils/ant-build/output/test.jar

BUILD SUCCESSFUL
Total time: 1 minute 34 seconds

[Joel Håkansson]

Hello,

If you do a clean checkout, the lib dir will be there, you don't have to add it yourself. Maybe your other problem is related to an incomplete working copy as well. I cannot really debug this as the problematic configuration requires a specific OS which I don't have. Here I thought Java was supposed to avoid these problems, and yet there are people who don't have enough problems that come up with ways to keep them. The build works on Windows and on our build server (Linux) and I changed almost nothing in the build script, so there is probably something wrong with your environment. Or perhaps the Saxon version is wrong. I can't really justify working on this, so I can't promise anything, but I am installing Debian now.

/Joel

-----Ursprungligt meddelande-----
Från: braill...@googlegroups.com [mailto:braill...@googlegroups.com] För Sebastian Humenda
Skickat: den 22 augusti 2013 12:10
Till: braill...@googlegroups.com
Ämne: Re: Build failure with latest trunk

[Sebastian Humenda]

Hello Joel,

after some ours of hunting down some errors of mine, re-importing the original
source and finding an error of Bert, I finally have a smoothly compiling and
even more smoothly running brailleUtils binary!
Thank you both for your excellent support.

We have however one runtime-problem left:
$ brailleutils input.brl output.pef -mode=en_gb
Starting text to pef application...
Validating result...
Validating out.pef using "PEF Validator": A validator for PEF 1.0 files.
Exception in thread "main" javax.xml.transform.TransformerFactoryConfigurationError: Provider net.sf.saxon.TransformerFactoryImpl not found
at javax.xml.transform.TransformerFactory.newInstance(TransformerFactory.java:107)
at org.daisy.braille.pef.PEFValidator.transformSchematron(PEFValidator.java:167)
at org.daisy.braille.pef.PEFValidator.validate(PEFValidator.java:123)
at org.daisy.braille.pef.PEFValidator.validate(PEFValidator.java:87)
at org.daisy.braille.facade.PEFValidatorFacade.validate(PEFValidatorFacade.java:64)
at org.daisy.braille.ui.TextParser.main(TextParser.java:82)
at org.daisy.braille.ui.BasicUI.run(BasicUI.java:114)
at org.daisy.braille.ui.BasicUI.main(BasicUI.java:143)
Caused by: java.lang.ClassNotFoundException: net.sf.saxon.TransformerFactoryImpl
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at javax.xml.transform.FactoryFinder.getProviderClass(FactoryFinder.java:119)
at javax.xml.transform.FactoryFinder.newInstance(FactoryFinder.java:182)
at javax.xml.transform.FactoryFinder.findJarServiceProvider(FactoryFinder.java:364)
at javax.xml.transform.FactoryFinder.find(FactoryFinder.java:286)
at javax.xml.transform.TransformerFactory.newInstance(TransformerFactory.java:101)
... 7 more

The classpath should be correct, so my guess is that saxon is too old, 6.5.5
here. Or do you have a better guess?

Thanks
Sebastian

[Joel Håkansson]

I am struggling to get the build running on Debian myself, what error of Bert's did you find?

You must use a Saxon above 6 because the location (and perhaps more importantly, the implementation) of the transformer factory changed (from net.sf.saxon.TransformerFactoryImpl to net.sf.saxon.TransformerFactoryImpl). The one used in Braille Utils is 8 (but that is for compatibility with Daisy Pipeline, and not because Saxon 9 has been proven not to work). From what I can see, our only options are 6 and 9, so I guess that the Debian people know that Saxon 7 and 8 are compatible with 9...

/Joel

-----Ursprungligt meddelande-----
Från: braill...@googlegroups.com [mailto:braill...@googlegroups.com] För Sebastian Humenda

Skickat: den 23 augusti 2013 12:17
Till: braill...@googlegroups.com
Ämne: run-time class path Re: Build failure with latest trunk

[Sebastian Humenda]

Hello Joel,

Joel Håkansson schrieb am 23.08.2013, 12:36 +0200:
>I am struggling to get the build running on Debian myself, what error of Bert's did you find?

This had to do with the packaging, not in your source. I took his pom.xml and he
spelled brailleutils with a lower u, which does not matter on Windows but on
*nix.

>You must use a Saxon above 6 because the location (and perhaps more
>importantly, the implementation) of the transformer factory changed (from
>net.sf.saxon.TransformerFactoryImpl to net.sf.saxon.TransformerFactoryImpl).
>The one used in Braille Utils is 8 (but that is for compatibility with Daisy
>Pipeline, and not because Saxon 9 has been proven not to work). From what I can
>see, our only options are 6 and 9, so I guess that the Debian people know that
>Saxon 7 and 8 are compatible with 9...

Where have you seen saxon 9?
# aptitude show libsaxon-java
Version: 1:6.5.5-10

I'm running Debian Unstable, so I should have the latest packaged software.

But anyway, we have at least identified the problem.

[Joel Håkansson]

I don't know how you made it work. It seems like the version of Jing used in Debian is causing the problem (by manually replacing the files one by one, util it broke).

/Joel

-----Ursprungligt meddelande-----
Från: braill...@googlegroups.com [mailto:braill...@googlegroups.com] För Sebastian Humenda

Skickat: den 23 augusti 2013 13:19
Till: braill...@googlegroups.com
Ämne: Re: run-time class path Re: Build failure with latest trunk

[Sebastian Humenda]

Hello Joel,

Joel Håkansson schrieb am 23.08.2013, 15:05 +0200:
>I don't know how you made it work. It seems like the version of Jing used in
>Debian is causing the problem (by manually replacing the files one by one, util
>it broke).

libjing-java has the version 20090818 and I would guess that's the same you're are
using? At least this one was used in Bert's pom.xml. Anyway, I have removed the b
from saxonb.jar in build.debian.properties and afterwards just run
ant -DuseExternalJarsOnLinux=true. The error just occurs only when trying to
convert a file. I remember having had this error myself in a DocBook project.
But this error seems related to the version, Saxon 6.5.5 is way too old. Since
you have confirmed that, I seem to need update libsaxon-java myself, *sigh*.

Which Debian-version are you using? I'm running Debian unstable, maybe the
stable version is too old.

[Sebastian Humenda]

Hello Joel,

I now dropped in in the Debian-java IRC channel and they told me that
libsaxonb-java is the saxon 9.1 release, so it had a good reason to include the
“b”, even though I forgot that. When now building a then running the program, I
get:
$ brailleutils text2pef in.brl out.pef -mode=en_gb

Starting text to pef application...
Validating result...
Validating out.pef using "PEF Validator": A validator for PEF 1.0 files.

Validation was unsuccessful
Messages returned by the validator:
net.sf.saxon.TransformerFactoryImpl
java.lang.IllegalArgumentException: invalid input for CompactParseable
at com.thaiopensource.relaxng.parse.compact.CompactParseable.makeReader(CompactParseable.java:80)
at com.thaiopensource.relaxng.parse.compact.CompactParseable.parse(CompactParseable.java:40)
at com.thaiopensource.relaxng.pattern.SchemaBuilderImpl.parse(SchemaBuilderImpl.java:76)
at com.thaiopensource.validate.rng.impl.SchemaReaderImpl.createSchema(SchemaReaderImpl.java:60)
at com.thaiopensource.validate.AbstractSchemaReader.createSchema(AbstractSchemaReader.java:13)
at com.thaiopensource.validate.schematron.SchemaReaderImpl.<init>(SchemaReaderImpl.java:87)
at com.thaiopensource.validate.schematron.SchematronSchemaReaderFactory.createSchemaReader(SchematronSchemaReaderFactory.java:18)
at com.thaiopensource.validate.SchemaReaderLoader.createSchemaReader(SchemaReaderLoader.java:19)
at com.thaiopensource.validate.auto.SchemaReaderFactorySchemaReceiverFactory.createSchemaReceiver(SchemaReaderFactorySchemaReceiverFactory.java:17)
at com.thaiopensource.validate.auto.SchemaReceiverLoader.createSchemaReceiver(SchemaReceiverLoader.java:15)
at com.thaiopensource.validate.auto.AutoSchemaReceiver$Handler.startElement(AutoSchemaReceiver.java:46)
at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source)
at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElementAfterName(Unknown Source)
at org.apache.xerces.impl.XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook(Unknown Source)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
at com.thaiopensource.validate.auto.AutoSchemaReader.createSchema(AutoSchemaReader.java:69)
at com.thaiopensource.validate.ValidationDriver.loadSchema(ValidationDriver.java:126)
at org.daisy.braille.pef.PEFValidator.runValidation(PEFValidator.java:147)
at org.daisy.braille.pef.PEFValidator.validate(PEFValidator.java:124)

at org.daisy.braille.pef.PEFValidator.validate(PEFValidator.java:87)
at org.daisy.braille.facade.PEFValidatorFacade.validate(PEFValidatorFacade.java:64)
at org.daisy.braille.ui.TextParser.main(TextParser.java:82)
at org.daisy.braille.ui.BasicUI.run(BasicUI.java:114)
at org.daisy.braille.ui.BasicUI.main(BasicUI.java:143)

Warning: Validation failed for out.pef

Do you have any conclusion what is wrong there? I also unzipped the jars and
corrected the class path to absolute paths, with no success.

Thanks

[Joel Håkansson]

Saxon 9 works for me. There is a temp file created right after the "net.sf.saxon.TransformerFactoryImpl" message is printed and looking at the code in Jing, this file appears to be null. So either the transformation or the writing of that file isn't happening. We know that it works if you download the distribution from google code, right? So it must have something to do with the packaging. A code change should not be required. If you're building with Maven, maybe the resource file is not included? Check the jar for this path: org\daisy\braille\pef\resource-files\
There should be a file there named "RNG2Schtrn.xsl"

Best,

Joel

-----Ursprungligt meddelande-----
Från: braill...@googlegroups.com [mailto:braill...@googlegroups.com] För Sebastian Humenda

Skickat: den 31 augusti 2013 21:51
Till: braill...@googlegroups.com
Ämne: Re: SV: run-time class path Re: Build failure with latest trunk