Hadoop Mode - Parser Mismatch Error

[mfu...@spryinc.com]

I stared getting this message periodically int he console when testing Lingual cascading flows in Hadoop platform mode.  Has anyone got this?  Probably not related to Lingual.

2014-01-09 09:32:35,787 ERROR conf.Configuration (Configuration.java:loadResource(1133)) - Failed to set setXIncludeAware(true) for parser org.apache.xerces.jaxp.DocumentBuilderFactoryImpl@3b34c0a6:java.lang.UnsupportedOperationException: This parser does not support specification "null" version "null"
java.lang.UnsupportedOperationException: This parser does not support specification "null" version "null"
    at javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:590)
    at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1131)
    at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1107)
    at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1053)
    at org.apache.hadoop.conf.Configuration.get(Configuration.java:397)
    at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:475)
    at org.apache.hadoop.hdfs.protocol.FSConstants.<clinit>(FSConstants.java:49)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:3645)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:3588)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2600(DFSClient.java:2783)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:3023)

[Andre Kelpe]

This usually means that your xalan and xerces are too old. Which hadoop distro are you using?

- André

--
You received this message because you are subscribed to the Google Groups "Lingual User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lingual-user...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
André Kelpe
an...@concurrentinc.com
http://concurrentinc.com

[Mark Fuini]

This is the Cascading internal hadoop cluster.  So whatever is shipping in Cascading 2.5.

--
You received this message because you are subscribed to a topic in the Google Groups "Lingual User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/lingual-user/MM3mD_WbZ7c/unsubscribe.
To unsubscribe from this group and all its topics, send an email to lingual-user...@googlegroups.com.

[Andre Kelpe]

Cascading-hadoop 2.5.1 is built against Apache Hadoop 1.2.1: http://conjars.org/cascading/cascading-hadoop/versions/2.5.1

Can you add xalan:xalan:2.7.1 and xerces:xercesImpl:2.11.0 to your project and see if that fixes the problem? The thing is, that the JDK contains outdated copies of xalan and xerces and sometimes that causes classpath foobar. I still don't understand, why this only fails sometimes, but adding the newer versions to your project will fix the problem.

- André

[mfu...@spryinc.com]

Seems like those changes made the message go away.  Hopefully those versions are backwards compatible with everything else.

Thanks!

[Branky Shao]

FYI. I exclude xercesImpl from lingual fix this error.

 <dependency>

          <groupId>cascading</groupId>

          <artifactId>lingual-hadoop</artifactId>

          <version>1.0.1</version>

          <exclusions>

              <exclusion>

                  <groupId>xerces</groupId>

                  <artifactId>xercesImpl</artifactId>

              </exclusion>

          </exclusions>

      </dependency>