Unable to load walkmod.xml

[jll...@gmail.com]

Hi,

I'm getting an error when I try to execute "walkmod apply":

Exception in thread "main" org.walkmod.conf.ConfigurationException: Unable to lo
ad C:\project\walkmod.xml
at org.walkmod.conf.providers.XMLConfigurationProvider.loadDocument(XMLC
onfigurationProvider.java:164)
at org.walkmod.conf.providers.XMLConfigurationProvider.init(XMLConfigura
tionProvider.java:121)
at org.walkmod.conf.ConfigurationManager.executeConfigurationProviders(C
onfigurationManager.java:75)
at org.walkmod.conf.ConfigurationManager.<init>(ConfigurationManager.jav
a:53)
at org.walkmod.WalkModDispatcher.main(WalkModDispatcher.java:126)
Caused by: Connection timed out: connect - org.walkmod.util.location.LocationImp
l@14dc6233
at org.walkmod.util.DomHelper.parse(DomHelper.java:82)
at org.walkmod.conf.providers.XMLConfigurationProvider.loadDocument(XMLC
onfigurationProvider.java:162)
... 4 more
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketI
mpl.java:79)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.ja
va:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocket
Impl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java
:182)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:378)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:473)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:203)
at sun.net.www.http.HttpClient.New(HttpClient.java:290)
at sun.net.www.http.HttpClient.New(HttpClient.java:306)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLC
onnection.java:995)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConne
ction.java:931)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection
.java:849)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:1299)
at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrent
Entity(XMLEntityManager.java:633)
at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(
XMLEntityManager.java:1271)
at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEnti
ty(XMLEntityManager.java:1238)
at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSou
rce(XMLDTDScannerImpl.java:260)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDri
ver.dispatch(XMLDocumentScannerImpl.java:1153)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDri
ver.next(XMLDocumentScannerImpl.java:1049)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$Prolog
Driver.next(XMLDocumentScannerImpl.java:962)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(X
MLDocumentScannerImpl.java:607)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next
(XMLNSDocumentScannerImpl.java:116)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImp
l.scanDocument(XMLDocumentFragmentScannerImpl.java:489)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(X
ML11Configuration.java:835)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(X
ML11Configuration.java:764)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.
java:123)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Ab
stractSAXParser.java:1210)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.p
arse(SAXParserImpl.java:568)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParser
Impl.java:302)
at org.walkmod.util.DomHelper.parse(DomHelper.java:79)
... 5 more

Here my walkmod.xml :
<!DOCTYPE walkmod PUBLIC "-//WALKMOD//DTD" "http://www.walkmod.com/dtd/walkmod-1.0.dtd" >
<walkmod>
<chain name="example-chain" >
<reader path="src/" />
<transformation type="walkmod:commons:import-cleaner" />
<writer path="src/"/>
</chain>
</walkmod>


I'm behind a proxy. Could it be a problem?

Thanks,
Juan Lladó

[walkmod]

Hi,

You need to declare the imports cleaner plugin in your walkmod.xml before applying it. Sorry, I forgot to update the documentation of this example when Walkmod becomes modularized. I have updated the documentation of the web page right now :). 

Your walkmod.xml should be:

<!DOCTYPE walkmod PUBLIC "-//WALKMOD//DTD"  "http://www.walkmod.com/dtd/walkmod-1.0.dtd" >

<walkmod>

<plugins>

<plugin groupId="org.walkmod" artifactId="walkmod-imports-cleaner-plugin"

version="2.0" />

</plugins>

<chain name="example-chain">

<reader path="src/" />

<transformation type="walkmod:commons:import-cleaner" />

<writer path="src/" />

</chain>

</walkmod> 

[jll...@gmail.com]

Thanks for the answer but I'm afraid I'm still getting the same error :S.

El lunes, 18 de agosto de 2014 12:57:13 UTC+2, walkmod escribió:
> Hi,
>
>
> You need to declare the imports cleaner plugin in your walkmod.xml before applying it. Sorry, I forgot to update the documentation of this example when Walkmod becomes modularized. I have updated the documentation of the web page right now :). 
>
>
> Your walkmod.xml should be:
>

> <!DOCTYPE walkmod PUBLIC "-//WALKMOD//DTD"  "http://www.walkmod.com/dtd/walkmod-1.0.dtd" > 
> <walkmod> 

>    <plugin groupId="org.walkmod" artifactId="walkmod-imports-cleaner-plugin" version="2.0" />

>   <chain name="example-chain" > 
>     <reader path="src/" /> 
>     <transformation type="walkmod:commons:import-cleaner" /> 
>     <writer path="src/"/> 
>   </chain> 
> </walkmod> 
>
>

> El lunes, 18 de agosto de 2014 12:30:16 UTC+2, jll...@gmail.com escribió:Hi,

[walkmod]

Hi,

Ok, analyzing the stacktrace, the error is related with your HTTP connection. Walkmod creates connections to resolve DTD's and download Maven artifacts through Ivy. Therefore, you need to configure the JVM to use a given proxy configuration (http://stackoverflow.com/questions/120797/how-do-i-set-the-proxy-to-be-used-by-the-jvm).

So, setting the following environment variable with your proxy connection configuration, it should work.

WALKMOD_OPTS="-Dhttp.proxyHost=yourProxyIP -Dhttp.proxyPort=yourProxyPort"

Let me know if it works because I don't have proxies to check it ;). Sorry for the inconvenience.

[jll...@gmail.com]

I'm sorry but now I'm getting another error:
-------------------
INFO [main] - c:\project\walkmod.xml [ok]
:: loading settings :: file = C:\apps\walkmod-1.0-SNAPSHOT\config\ivy
settings.xml
:: loading settings :: url = jar:file:/C:/dev_jllado/ides/walkmod-1.0-SNAPSHOT/l
ib/walkmod-1.0-SNAPSHOT-jar-with-dependencies.jar!/org/apache/ivy/core/settings/
ivysettings.xml
Exception in thread "main" org.walkmod.conf.ConfigurationException: Unable to re
solve the plugin: org.walkmod : walkmod-imports-cleaner-plugin : 2.0
at org.walkmod.conf.providers.IvyConfigurationProvider.load(IvyConfigura
tionProvider.java:91)
at org.walkmod.conf.ConfigurationManager.executeConfigurationProviders(C
onfigurationManager.java:76)

at org.walkmod.conf.ConfigurationManager.<init>(ConfigurationManager.jav
a:53)
at org.walkmod.WalkModDispatcher.main(WalkModDispatcher.java:126)

Caused by: java.lang.NullPointerException
at org.walkmod.conf.providers.IvyConfigurationProvider.resolveArtifact(I
vyConfigurationProvider.java:134)
at org.walkmod.conf.providers.IvyConfigurationProvider.load(IvyConfigura
tionProvider.java:75)
... 3 more
-------------------

I've set the environment variable:
WALKMOD_OPTS = -Dhttp.proxyHost=10.150.2.39 -Dhttp.proxyPort=8080 -Dhttp.proxyUser=XXXXXXX -Dhttp.proxyPassword=xxxxxxxx

I don't know nothing about Ivy but maybe I should set the proxy in Ivi settings (like in Maven)

Any idea?

Thanks!,
Juan Lladó

[walkmod]

Ok,

Now, your DTD is resolved but Ivy is not reading the proxy settings. I would try editing ${WALKMOD_HOME}/config/ivysettings.xml  with your proxy configuration using property tags (The official documentation - http://ant.apache.org/ivy/history/2.0.0/settings.html - tells Java system variables are available as ivy variables. So, I suspect these can be overwriten). If the error persists, try to create an environment variable called ANT_OPTS with the same content than WALKMOD_OPTS. 

Please, let me know if it works and I will improve Walkmod to load automatically the WALKMOD_OPTS as Ivy variables :) !

<ivysettings>
 <property name="http.proxyHost" value="XXXXXX"/>
 <property name="http.proxyPort" value="XXXXXX"/>
 <property name="http.proxyUser" value="XXXXXX"/>
 <property name="http.proxyPassword" value="XXXXX"/>
 <settings defaultResolver="walkmod-core" />
 <configurations defaultconfmapping="compile->compile">
 </configurations>
 <resolvers>
 <chain name="walkmod-core">
   <ibiblio name="maven2" m2compatible="true" />
   <ibiblio name="jboss" root="http://repository.jboss.com/maven2"   m2compatible="true" usepoms="false"/>
   <ibiblio name="springsource-external" m2compatible="true" root="http://repository.springsource.com/maven/bundles/external"/>
   <ibiblio name="springsource-release" m2compatible="true" root="http://repository.springsource.com/maven/bundles/release"/>
 </chain>
 </resolvers>
</ivysettings>

[jll...@gmail.com]

Arggg, still not working. And I have tried both ways.

Ivy settings with the proxy config:
<ivysettings>
<property name="http.proxyHost" value="10.150.2.39"/>
<property name="http.proxyPort" value="8080"/>
<property name="http.proxyUser" value="XXXXXXXXX"/>
<property name="http.proxyPassword" value="XXXXXXXXX"/>

<settings defaultResolver="walkmod-core" />
<configurations defaultconfmapping="compile->compile">
</configurations>
<resolvers>
<chain name="walkmod-core">
<ibiblio name="maven2" m2compatible="true" />
<ibiblio name="jboss" root="http://repository.jboss.com/maven2" m2compatible="true" usepoms="false"/>
<ibiblio name="springsource-external" m2compatible="true" root="http://repository.springsource.com/maven/bundles/external"/>
<ibiblio name="springsource-release" m2compatible="true" root="http://repository.springsource.com/maven/bundles/release"/>
</chain>
</resolvers>
</ivysettings>

And another environment variable:
ANT_OPTS = -Dhttp.proxyHost=10.150.2.39 -Dhttp.proxyPort=8080 -Dhttp.proxyUser=XXXXXXXXX -Dhttp.proxyPassword=XXXXXXXXX

Maybe the Ivy settings isn't correct... What do you think?

El martes, 19 de agosto de 2014 10:01:28 UTC+2, walkmod escribió:
> Ok,
>
>
> Now, your DTD is resolved but Ivy is not reading the proxy settings. I would try editing ${WALKMOD_HOME}/config/ivysettings.xml  with your proxy configuration using property tags (The official documentation - http://ant.apache.org/ivy/history/2.0.0/settings.html - tells Java system variables are available as ivy variables. So, I suspect these can be overwriten). If the error persists, try to create an environment variable called ANT_OPTS with the same content than WALKMOD_OPTS. 
>
>
> Please, let me know if it works and I will improve Walkmod to load automatically the WALKMOD_OPTS as Ivy variables :) !
>
>
>
> <ivysettings>
>  <property name="http.proxyHost" value="XXXXXX"/>
>  <property name="http.proxyPort" value="XXXXXX"/>
>  <property name="http.proxyUser" value="XXXXXX"/>
>  <property name="http.proxyPassword" value="XXXXX"/>
>  <settings defaultResolver="walkmod-core" />
>  <configurations defaultconfmapping="compile->compile">
>  </configurations>
>  <resolvers>
>  <chain name="walkmod-core">
>    <ibiblio name="maven2" m2compatible="true" />
>    <ibiblio name="jboss" root="http://repository.jboss.com/maven2"   m2compatible="true" usepoms="false"/>
>    <ibiblio name="springsource-external" m2compatible="true" root="http://repository.springsource.com/maven/bundles/external"/>
>    <ibiblio name="springsource-release" m2compatible="true" root="http://repository.springsource.com/maven/bundles/release"/>
>  </chain>
>  </resolvers>
> </ivysettings>
>
>
>
>
>
>

[walkmod]

Ok, no problem and sorry for the inconvenience. 

I have recommended some advices I have read for Ivy because I dont' have the appropiate environment to reproduce your error right now. 

This week I will publish a new version with some bugs fixed and I will add clear stacktrace for this component. I will be grateful if you could repeat the execution with the new version and send me the new stacktrace. I also will try to create a similar environment to test walkmod.

We keep in contact!

[jll...@gmail.com]

Thanks for your help.

Let me know if I can help you with something :-)

[walkmod]

Hi,

I have uploaded the new version (1.0.6). I would be grateful if you could print here again the error stack trace when you have time. It should be more clear to understand.

Thank you :) !

[jll...@gmail.com]

Hi,

I've downloaded the new version:
https://bitbucket.org/rpau/walkmod/downloads/walkmod-1.0.6-installer.zip

And then I've replaced the files (except config files). But I think it's giving me the same error message:

INFO [main] - C:\dev_jllado\workspace_luna\hotel\walkmod.xml [ok]
:: loading settings :: file = C:\dev_jllado\ides\walkmod-1.0-SNAPSHOT\config\ivy

settings.xml
:: loading settings :: url = jar:file:/C:/dev_jllado/ides/walkmod-1.0-SNAPSHOT/l

ib/ivy-2.4.0-rc1.jar!/org/apache/ivy/core/settings/ivysettings.xml

Exception in thread "main" org.walkmod.conf.ConfigurationException: Unable to re
solve the plugin: org.walkmod : walkmod-imports-cleaner-plugin : 2.0
at org.walkmod.conf.providers.IvyConfigurationProvider.load(IvyConfigura
tionProvider.java:91)
at org.walkmod.conf.ConfigurationManager.executeConfigurationProviders(C
onfigurationManager.java:76)
at org.walkmod.conf.ConfigurationManager.<init>(ConfigurationManager.jav
a:53)
at org.walkmod.WalkModDispatcher.main(WalkModDispatcher.java:126)
Caused by: java.lang.NullPointerException
at org.walkmod.conf.providers.IvyConfigurationProvider.resolveArtifact(I
vyConfigurationProvider.java:134)
at org.walkmod.conf.providers.IvyConfigurationProvider.load(IvyConfigura
tionProvider.java:75)
... 3 more

Thanks!

El jueves, 21 de agosto de 2014 18:15:55 UTC+2, walkmod escribió:
> Hi,
>
>
> I have uploaded the new version (1.0.6). I would be grateful if you could print here again the error stack trace when you have time. It should be more clear to understand.
>
>
> Thank you :) !
>

> El jueves, 21 de agosto de 2014 08:04:04 UTC+2, jll...@gmail.com escribió:Thanks for your help.

> &g...

[walkmod]

Have you deleted the whole contents of ${WALKMOD_HOME}/lib directory before adding the new ones? It seems that you are executing the old jar (walkmod-core-1.0.5) instead of walkmod-core-1.0.6.jar. Probably, you have both if you have combined the lib directories. 

Otherwise, ghosts exist! because in the stacktrace appears lines that currently they do not have code :)

Thank you for your feedback and help us to improve! 

[jll...@gmail.com]

Yes. It was the reason ^^. And... Uooooo!!! Now it works :-D But it finishes with an error:
INFO [main] - TRANSFORMATION CHAIN FAILS

--------------------------------------------------------------------------------

INFO [main] - Total time: 9,969 seconds
INFO [main] - Finished at: Tue, 26 Aug 2014 10:30:18
INFO [main] - Final memory: 44 M/ 91 M
--------------------------------------------------------------------------------

INFO [main] - Please, see the walkmod log file for details
ERROR [main] - TRANSFORMATION CHAIN (example-chain) FAILS
An exeception has been produced during the walkmod:commons:import-cleaner transf
ormation - org.walkmod.util.location.LocationImpl@6f78ed09
at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.walkmod.walkers.AbstractWalker.walk(AbstractWalker.java:260)
at org.walkmod.walkers.AbstractWalker.execute(AbstractWalker.java:275)
at org.walkmod.impl.DefaultChainWalkerInvocation.invoke(DefaultChainWalk
erInvocation.java:42)
at org.walkmod.impl.DefaultChainInvocation.invoke(DefaultChainInvocation
.java:38)
at org.walkmod.impl.DefaultChainAdapter.execute(DefaultChainAdapter.java
:173)
at org.walkmod.WalkModFacade.executeAllChains(WalkModFacade.java:362)
at org.walkmod.WalkModFacade.apply(WalkModFacade.java:137)
at org.walkmod.WalkModDispatcher.main(WalkModDispatcher.java:115)
Caused by: java.lang.reflect.InvocationTargetException
... 11 more
Caused by: org.walkmod.javalang.TokenMgrError: Lexical error at line 1, column 1
. Encountered: "\ufeff" (65279), after : ""
at org.walkmod.javalang.ASTParserTokenManager.getNextToken(ASTParserToke
nManager.java:2536)
at org.walkmod.javalang.ASTParser.jj_scan_token(ASTParser.java:8912)
at org.walkmod.javalang.ASTParser.jj_3R_212(ASTParser.java:8234)
at org.walkmod.javalang.ASTParser.jj_3R_177(ASTParser.java:8307)
at org.walkmod.javalang.ASTParser.jj_3R_122(ASTParser.java:8339)
at org.walkmod.javalang.ASTParser.jj_3R_121(ASTParser.java:6796)
at org.walkmod.javalang.ASTParser.jj_3R_71(ASTParser.java:6815)
at org.walkmod.javalang.ASTParser.jj_3_1(ASTParser.java:6835)
at org.walkmod.javalang.ASTParser.jj_2_1(ASTParser.java:4988)
at org.walkmod.javalang.ASTParser.CompilationUnit(ASTParser.java:127)
at org.walkmod.javalang.ASTManager.parse(ASTManager.java:134)
at org.walkmod.javalang.ASTManager.parse(ASTManager.java:113)
at org.walkmod.javalang.walkers.DefaultJavaParser.parse(DefaultJavaParse
r.java:71)
at org.walkmod.javalang.walkers.DefaultJavaParser.parse(DefaultJavaParse
r.java:27)
at org.walkmod.javalang.walkers.DefaultJavaWalker.visit(DefaultJavaWalke
r.java:68)
at org.walkmod.javalang.walkers.DefaultJavaWalker.accept(DefaultJavaWalk
er.java:61)
... 11 more


My walkmod.xml:

<!DOCTYPE walkmod PUBLIC "-//WALKMOD//DTD" "http://www.walkmod.com/dtd/walkmod-1.0.dtd" >
<walkmod>

<plugins>

<plugin groupId="org.walkmod" artifactId="walkmod-imports-cleaner-plugin" version="2.0" />

</plugins>

<chain name="example-chain" >
<reader path="src/" />
<transformation type="walkmod:commons:import-cleaner" />
<writer path="src/"/>
</chain>
</walkmod>

Any idea?

Thanks!!!

> > > > > >         at org.walkmo...

[walkmod]

Ok great! Ivy works. 

Now we have a parser problem. Which encoding do you use? Walkmod assumes UTF-8. Otherwise, I will create a test for that because it is a bug.

[walkmod]

I have found the following information:

• The U+FEFF is the BOM character (http://en.wikipedia.org/wiki/Byte_order_mark) and it is recommended to remove it in Java source files (http://www.rgagnon.com/javadetails/java-handle-utf8-file-with-bom.html). However, there is a simple way to handle them and I will do it for the next version.
• To remove the BOM character manually, it is reported in http://stackoverflow.com/questions/18029992/how-do-i-remove-a-ufeff-character-in-my-webpage-scripts. It is very easy with Notepad++.
  

...

[jll...@gmail.com]

Oh. It's great!

I know we have this problem in our project. It seems like someone of our team is changing the encoding of the files... But now Walkmod can alert us about it ;-).

It will be great if there could be a rule for walkmod to remove BOM from the files :-D

Thanks for your help. And congrats for the app ;-)

El martes, 26 de agosto de 2014 11:08:21 UTC+2, walkmod escribió:
> I have found the following information:
>
>

> The U+FEFF is the BOM character (http://en.wikipedia.org/wiki/Byte_order_mark) and it is recommended to remove it in Java source files (http://www.rgagnon.com/javadetails/java-handle-utf8-file-with-bom.html). However, there is a simple way to handle them and I will do it for the next version.To remove the BOM character manually, it is reported in http://stackoverflow.com/questions/18029992/how-do-i-remove-a-ufeff-character-in-my-webpage-scripts. It is very easy with Notepad++.

> &g...

[jll...@gmail.com]

Hi,

It's not the subject of this thread but when walmod applies this configuration:

<!DOCTYPE walkmod PUBLIC "-//WALKMOD//DTD" "http://www.walkmod.com/dtd/walkmod-1.0.dtd" >
<walkmod>
<plugins>
<plugin groupId="org.walkmod" artifactId="walkmod-imports-cleaner-plugin" version="2.0" />
</plugins>
<chain name="example-chain" >
<reader path="src/" />
<transformation type="walkmod:commons:import-cleaner" />
<writer path="src/"/>
</chain>
</walkmod>

It also applies some formatting rules (I suppose from formatter.xml).

The problem is that wakmod changes all the tabulation's chars (spaces to tabs). Althought one of the rules is:
<setting id="org.eclipse.jdt.core.formatter.tabulation.char" value="space"/>

Any idea why? Maybe I'm doing something wrong or I don't understand something.

Thanks,
Juan Lladó

PD:
If you prefer, I can open other thread.

[walkmod]

Hi, 

You are righ. Walkmod should apply spaces. Indeed, walkmod invokes the eclipse formatter with the formatter.xml configuration. 

Let me check it today and I tell you what is happening. I would prefer open a new thread, because it is easier for somebody has the same problem.

Thanks :)

> ...

[walkmod]

Hi,

I have added a simple test into the component that applies the eclipse formatter (https://github.com/rpau/walkmod-java-formatter-plugin) and it works. If you want, add a test that makes it fail and I will inspect what happens.

Thanks

...