Maven Build error

[Sathish Thangathurai]

Hi All,

I'm new to opencast 2.0 and setting up the development environment.While setting up I've download the matterhorn r/2.0.x branch and during build i'm facing the below error

[INFO] --- frontend-maven-plugin:0.0.23:npm (npm install) @ matterhorn-admin-ui-ng ---

[INFO] Running 'npm install --color=false' in /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng

[ERROR] npm WARN package.json Matterhor...@0.0.1 No repository field.

[ERROR] npm WARN package.json Matterhor...@0.0.1 No README data

[ERROR] npm WARN package.json karma-coffee...@0.2.1 No README data

[ERROR] npm WARN package.json karma-c...@0.2.7 No README data

[ERROR] npm WARN package.json karma-phanto...@0.1.4 No README data

[INFO] 

[INFO] --- frontend-maven-plugin:0.0.23:grunt (grunt build) @ matterhorn-admin-ui-ng ---

[INFO] Running 'grunt build --no-color --skipTests=true' in /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng

[ERROR] module.js:338

[ERROR]     throw err;

[ERROR]           ^

[ERROR] Error: Cannot find module 'findup-sync'

[ERROR]     at Function.Module._resolveFilename (module.js:336:15)

[ERROR]     at Function.Module._load (module.js:278:25)

[ERROR]     at Module.require (module.js:365:17)

[ERROR]     at require (module.js:384:17)

[ERROR]     at Object.<anonymous> (/opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng/node_modules/grunt-cli/bin/grunt:8:14)

[ERROR]     at Module._compile (module.js:460:26)

[ERROR]     at Object.Module._extensions..js (module.js:478:10)

[ERROR]     at Module.load (module.js:355:32)

[ERROR]     at Function.Module._load (module.js:310:12)

[ERROR]     at Function.Module.runMain (module.js:501:10)

Could any one faced this kind of exception? Any hint would be highly appreciable.

I've been using eclipse to build the bundle like in Eclipse-> Run configuration-> I've set mvn command as "deployTo" as Parameter name and "/opt/matterhorn/matterhorn" as 

parameter value also selected the base as profile (build all bundle) from workspace to build the bundle.

Thanks,

Sathish Thangathurai

[Lars Kiesow]

Hi Sathish.
can you give us the whole output for the failed build? Or at least the
whole module? If possible, use something like http://fpaste.org. Better
than to have a full log as email body ;)
–Lars

On Fri, 28 Aug 2015 22:25:14 -0700 (PDT)
Sathish Thangathurai <sathish....@gmail.com> wrote:

> Hi All,
>
> I'm new to opencast 2.0 and setting up the development
> environment.While setting up I've download the matterhorn r/2.0.x
> branch and during build i'm facing the below error
>

[...]

[Sathish Thangathurai]

Hi Lars,

Can you look at the attached file,It has maven build output. I've paste the entire output and I've to remember what are the things i installed to set up development.Let me give the brief description.

Services:

-------------

1) Mysql and also installed script from matterhorn docs

2) nginx for both (http and rtmp)

3) activemq

Next, I've to build matterhorn to install solr. so i decided to build matterhorn via eclipse. Above three services are installed separately, because once installed every service we can point in the config.properties file. However, I'm facing build error and i can't go for the next step.

Lars, Please help me to setup development environment also every node (admin, worker, ingest and engage are in single machine).

I've attached the file rather than paste the output from your given url (http://fpaste.org) when i was pasting the output, it doesn't give any output url. I don't know the reason,even though I hope it will make sense in the future.

Thanks,

Sathish Thangathurai

[Lars Kiesow]

Hi,
first of all, MySQL, Nginx and ActiveMQ should not affect the build
process in any way.

Looking at the build log, I do not really know what the cause of the
problem is, though two things come to mind. I have also verified that
the latest state of r/2.0.x compiles for me without any problems.

Possible causes:

- You said that you installed the 3rd-party tools (FFmpeg, ...) using
the install script mentioned in our docs. The install scripts were
deprecated with 2.0 and should not be mentioned anywhere in the docs
anymore. This could cause problems though judging from the error I
think it is unlikely that it does.

- I did not use eclipse and never used eclipse for Opencast
development. But I know that 2.0 requires a recent version of Maven
to be compiled. If you used the eclipse binary package, it might be
that your bundled maven version is simply to old. Can you try using
maven directly instead? Just a mvn clean install -Dall in the main
directory of Opencast should build everything so you can verify if
there are any problems.

Regards,
Lars

On Sun, 30 Aug 2015 09:40:10 -0700 (PDT)

> To unsubscribe from this group and stop receiving emails from it,
> send an email to matterhorn-use...@opencast.org.

[Karen Dolan]

Hi Sathish,

Your attached mvn build shows an error during building matterhorn-admin-ui-ng 2.0.0 [1]

Here are two thoughts, based on experiencing a similar problem and suggestions in Stackoverflow online help discussion [2]

1) Your system may be missing dependent libraries.

2) Your dependent Node libraries might have been installed with root permission and cannot be executed in the context of the mvn build.

Two Suggestions for gather more information:

1) Gather more error information: Run mvn clean install from the /modules/matterhorn-admin-ui-ng directory and include debugging flags -X -e.
For example:
modules/matterhorn-admin-ui-ng> mvn clean installl -DdeployTo=/opt/matterhorn -X -e

2) Verify the permissions on your Node libraries: For example, to check permissions on the grunt-cli directory run the following
> sudo find /usr/ -name grunt-cli -type d

Best of luck,
Karen


[1] from Sathish's build output
[INFO] --- frontend-maven-plugin:0.0.23:install-node-and-npm (install node and npm) @ matterhorn-admin-ui-ng ---
[INFO] Node v0.12.2 is already installed.
[INFO] Found NPM version 2.3.0
[INFO]

[INFO] --- frontend-maven-plugin:0.0.23:npm (npm install) @ matterhorn-admin-ui-ng ---
[INFO] Running 'npm install --color=false' in /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng
[ERROR] npm WARN package.json Matterhor...@0.0.1 No repository field.
[ERROR] npm WARN package.json Matterhor...@0.0.1 No README data

[ERROR] npm WARN package.json karma-c...@0.2.7 No README data
[ERROR] npm WARN package.json karma-coffee...@0.2.1 No README data
[ERROR] npm WARN package.json karma-phanto...@0.1.4 No README data
[INFO]
[INFO] --- frontend-maven-plugin:0.0.23:grunt (grunt build) @ matterhorn-admin-ui-ng ---

[INFO] Running 'grunt build --no-color --skipTests=false' in /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng

[ERROR] module.js:338
[ERROR] throw err;
[ERROR] ^
[ERROR] Error: Cannot find module 'findup-sync'
[ERROR] at Function.Module._resolveFilename (module.js:336:15)
[ERROR] at Function.Module._load (module.js:278:25)
[ERROR] at Module.require (module.js:365:17)
[ERROR] at require (module.js:384:17)
[ERROR] at Object.<anonymous> (/opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng/node_modules/grunt-cli/bin/grunt:8:14)
[ERROR] at Module._compile (module.js:460:26)
[ERROR] at Object.Module._extensions..js (module.js:478:10)
[ERROR] at Module.load (module.js:355:32)
[ERROR] at Function.Module._load (module.js:310:12)
[ERROR] at Function.Module.runMain (module.js:501:10)

[1] http://stackoverflow.com/questions/15444020/cannot-find-module-findup-sync-when-trying-to-run-grunt

[Sathish Thangathurai]

Hi Karen,

Following your suggestion, again try to build the matterhorn-admin-ui-ng using mvn clean install -DdeployTo=/opt/matterhorn -X -e. please look at the error message

Is this is a Permission issue? I didn't see any permission denied message in the below error message.

also I' using maven 3.2.3 version. Is this version is the right one for 2.0.x?

Note:

When i was using your command (what you've pointed to check permission) sudo find /usr/ -name grunt-cli -type d

Terminal doesn't show any thing (i.e., any location of the file, file permission, install location etc). 

so my concern is, Whether i need to install grunt manually? Can you send the latest documentation link to install matterhorn 2.0.x?

Thanks,

Sathish Thangathurai

[INFO] Running 'grunt build --no-color --skipTests=false' in /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng

[ERROR] module.js:338

[ERROR]     throw err;

[ERROR]           ^

[ERROR] Error: Cannot find module 'findup-sync'

[ERROR]     at Function.Module._resolveFilename (module.js:336:15)

[ERROR]     at Function.Module._load (module.js:278:25)

[ERROR]     at Module.require (module.js:365:17)

[ERROR]     at require (module.js:384:17)

[ERROR]     at Object.<anonymous> (/opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng/node_modules/grunt-cli/bin/grunt:8:14)

[ERROR]     at Module._compile (module.js:460:26)

[ERROR]     at Object.Module._extensions..js (module.js:478:10)

[ERROR]     at Module.load (module.js:355:32)

[ERROR]     at Function.Module._load (module.js:310:12)

[ERROR]     at Function.Module.runMain (module.js:501:10)

[INFO] ------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 21.167 s

[INFO] Finished at: 2015-09-01T08:05:08+05:30

[INFO] Final Memory: 33M/363M

[INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.23:grunt (grunt build) on project matterhorn-admin-ui-ng: Failed to run task: 'grunt build --no-color --skipTests=false' failed. (error code 1) -> [Help 1]

org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.23:grunt (grunt build) on project matterhorn-admin-ui-ng: Failed to run task

at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)

at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)

at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)

at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)

at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)

at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)

at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)

at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)

at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)

at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)

at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)

at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)

at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)

at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)

at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)

at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)

Caused by: org.apache.maven.plugin.MojoFailureException: Failed to run task

at com.github.eirslett.maven.plugins.frontend.mojo.GruntMojo.execute(GruntMojo.java:71)

at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)

at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)

... 19 more

Caused by: com.github.eirslett.maven.plugins.frontend.lib.TaskRunnerException: 'grunt build --no-color --skipTests=false' failed. (error code 1)

at com.github.eirslett.maven.plugins.frontend.lib.NodeTaskExecutor.execute(NodeTaskExecutor.java:38)

at com.github.eirslett.maven.plugins.frontend.mojo.GruntMojo.execute(GruntMojo.java:69)

... 21 more

[ERROR] 

[ERROR] 

[ERROR] For more information about the errors and possible solutions, please read the following articles:

[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

On Monday, August 31, 2015 at 5:58:12 PM UTC+5:30, Karen Dolan wrote:

Hi Sathish,

Your attached mvn build shows an error during building matterhorn-admin-ui-ng 2.0.0 [1]

Here are two thoughts, based on experiencing a similar problem and suggestions in Stackoverflow online help discussion [2]

1) Your system may be missing dependent libraries.

2) Your dependent Node libraries might have been installed with root permission and cannot be executed in the context of the mvn build.

Two Suggestions for gather more information:

1) Gather more error information: Run mvn clean install from the /modules/matterhorn-admin-ui-ng directory and include debugging flags -X -e.
For example:
 modules/matterhorn-admin-ui-ng>  mvn clean installl -DdeployTo=/opt/matterhorn -X -e

2) Verify the permissions on your Node libraries: For example, to check permissions on the grunt-cli directory run the following
> sudo find /usr/ -name grunt-cli -type d

Best of luck,
Karen


[1] from Sathish's build output
[INFO] --- frontend-maven-plugin:0.0.23:install-node-and-npm (install node and npm) @ matterhorn-admin-ui-ng ---
[INFO] Node v0.12.2 is already installed.
[INFO] Found NPM version 2.3.0
[INFO]
[INFO] --- frontend-maven-plugin:0.0.23:npm (npm install) @ matterhorn-admin-ui-ng ---
[INFO] Running 'npm install --color=false' in /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng
[ERROR] npm WARN package.json Matterhor...@0.0.1 No repository field.
[ERROR] npm WARN package.json Matterhor...@0.0.1 No README data
[ERROR] npm WARN package.json karma-c...@0.2.7 No README data

[ERROR] npm WARN package.json karma-coffee-preprocessor@0.2.1 No README data

[Karen Dolan]

Hi Sathish,

The error indicated that the build failed when maven called the the Grunt task because of the lack of a required supporting library when Grunt called out on one of its tasks. The missing module is called 'findup-sync'. This may be because that library was originally installed with different permissions or wasn't installed yet on the system. 

This is not part of maven, it supports Node, a different build tool. The advice suggested on the following post might help.

http://stackoverflow.com/questions/15444020/cannot-find-module-findup-sync-when-trying-to-run-grunt 

Regards,

Karen

[Sathish Thangathurai]

Hi Karen,

Your right, the package 'findup-sync' was not present. so i decide to install manually like running the command inside matterhorn-admin-ui-ng directory 

as npm install 'findup-sync'.The package was successfully installed inside the node_modules inside matterhorn-admin-ui-ng directory.

But, In the next time i'm getting the same error with different package name as 'coffee-script'.

So i decided the remove the entire node_modules directory from inside the directory "/opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng" because i guessed that 

entire dependencies can be install within one command as 'npm install'  by following your stackoverflow link inside matterhorn-admin-ui-ng directory (will install all the 

dependencies) rather than do it manually for every package ,but the npm did their work properly which means installed their dependencies inside node_modules directory

also, I've checked the permission for node_modules inside /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng directory,It seems the permission are in correct.

Then i decide to build the matterhorn-admin-ui-ng module individually as 'mvn clean install -DdeployTo=/opt/matterhorn/matterhorn -X -e'. Unfortunately, again I'm getting 

some different kind of error. Could you please look at my attached log file? please give me any hint or idea to solve the issue.

Thanks,

Sathish Thangathurai

[Karen Dolan]

Hi Sathish,

Then i decide to build the matterhorn-admin-ui-ng module individually as 'mvn clean install -DdeployTo=/opt/matterhorn/matterhorn -X -e'. Unfortunately, again I'm getting 

some different kind of error. Could you please look at my attached log file? please give me any hint or idea to solve the issue.

Its hopeful that only 3 of the 805 build-functional verification failed. Unfortunately, a single failure halts the build. Its unfortunate, but good because it ensures proper functioning code. 

Did you see any warning earlier in the build output to indicate that anything was missing but the it was building anyway?

ry the build a few times to verify that those three errors [2] consistently show up. There may be a connection between these failing test that identify the current issue.

- Karen

[1] PhantomJS 1.9.8 (Linux 0.0.0): Executed 805 of 816 (3 FAILED) (skipped 3) (11.979 secs / 11.885 secs)

[2] The three PhantomJs errors:

1. Stack trace from an Exception (the log you sent cut off the beginning of the stack trace, there may be more detail in your full log)

 "t/resources/test/unit/shared/resources/conflictCheckResourceSpec.js:73"

[...]

[INFO] PhantomJS 1.9.8 (Linux 0.0.0): Executed 367 of 816 (1 FAILED) (skipped 1)       PhantomJS 1.9.8 (Linux 0.0.0): Executed 368 of 816 (1 FAILED) (skipped 1)       PhantomJS 1.9.8 (Linux 0.0.0): Executed 369 of 816 (1 FAILED) (skipped 1) 

2. The first Test Expect Error

PhantomJS 1.9.8 (Linux 0.0.0) New Event API Resource assembles the metadata for SCHEDULE_MULTIPLE FAILED

[INFO] Expected { type : 'SCHEDULE_MULTIPLE', metadata : { start : '2014-07-17T04:30:00Z', device : '•mock• agent3', inputs : 'TRANSLATION.PATH.VIDEO', end : '2014-07-24T06:15:00Z', duration : '6300000', rrule : 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=30' } } to equal { type : 'SCHEDULE_MULTIPLE', metadata : { start : '2014-07-17T04:30:00Z', end : '2014-07-24T06:15:00Z', duration : '6300000', rrule : 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=0', device : '•mock• agent3', inputs : 'TRANSLATION.PATH.VIDEO' } }.

[INFO] Error: Expected { type : 'SCHEDULE_MULTIPLE', metadata : { start : '2014-07-17T04:30:00Z', device : '•mock• agent3', inputs : 'TRANSLATION.PATH.VIDEO', end : '2014-07-24T06:15:00Z', duration : '6300000', rrule : 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=30' } } to equal { type : 'SCHEDULE_MULTIPLE', metadata : { start : '2014-07-17T04:30:00Z', end : '2014-07-24T06:15:00Z', duration : '6300000', rrule : 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=0', device : '•mock• agent3', inputs : 'TRANSLATION.PATH.VIDEO' } }.

[INFO]    at /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng/src/test/resources/test/unit/shared/resources/newEventResourceSpec.js:174

[INFO] PhantomJS 1.9.8 (Linux 0.0.0): Executed 436 of 816 (2 FAILED) (skipped 1)       PhantomJS 1.9.8 (Linux 0.0.0): Executed 437 of 816 (2 FAILED) (skipped 1)       PhantomJS 1.9.8 (Linux 0.0.0): Executed 438 of 816 (2 FAILED) (skipped 1) 

3. The second Test Expect Error

PhantomJS 1.9.8 (Linux 0.0.0) JsHelper service #assembleRrule functions as expected FAILED

[INFO] Expected 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=30' to equal 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=0'.

[INFO] Error: Expected 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=30' to equal 'FREQ=WEEKLY;BYDAY=MO,TU,WE;BYHOUR=4;BYMINUTE=0'.

[INFO]    at /opt/matterhorn/matterhorn/modules/matterhorn-admin-ui-ng/src/test/resources/test/unit/shared/services/jsHelperServiceSpec.js:141

[INFO] PhantomJS 1.9.8 (Linux 0.0.0): Executed 574 of 816 (3 FAILED) (skipped 2)       PhantomJS 1.9.8 (Linux 0.0.0): Executed 575 of 816 (3 FAILED) (skipped 2)       PhantomJS 1.9.8 (Linux 0.0.0): Executed 576 of 816 (3 FAILED) (skipped 2)       

[Sathish Thangathurai]

Hi Karan,

The answer is yes. I got warning and attached the entire log in the log file. Your mentioned that it may the connection failed. What type of connection i'm missing?

Does i need to do any external configuration? because the reason is, i just cloned the matterhorn 2.0.x branch and started build also mysql, nginx and activemq are 

running as service, not yet configured in the <matterhorn home>/etc/config.properties file.

In my machine I've two account users (sysadmin and matterhorn). Is there any possible to have permission issue while building?

Regards,

Sathish Thangathurai

[Karen Dolan]

Hi Sathish,

My colleague noticed that your admin-ui-ng tests fail because of an unexpected missing 30 minutes. He has created a ticket for potential problem with timezone that are not full hours off the UTC, for instance TZ +5:30 and the admin-ui-ng tests.

Keep a watch on the ticket by getting an account on the opencast jira site and click "Start watching this issue" to see updates to the issue [1]. 

In the meantime, you could build the matterhorn-admin-ui-ng without the unit tests:

    "cd modules/matterhorn-admin-ui-ng", then "mvn clean install -DskipTests=true"

Then build the rest of the modules with their unit tests:

  "cd ../..", then the "mvn clean install -rf :matterhorn-admin-ui"

When you run the application, feel free to add comments to the jira ticket if you notice any 30-minute-off issues.

Regards,

Karen

[1] https://opencast.jira.com/browse/MH-11042

<log.txt>

[Sathish Thangathurai]

Hi Karen,

Thanks for the help. I was following your suggestion and in my local machine i've tested with sample video and it have been successfully running. 

I hope this discussion will help to newbie from different timezone who need opencast.

also  when i was installing mysql and run the script, I'm getting the permission denied for matterhorn user  (following the 

documentation (http://docs.opencast.org/latest/admin/configuration/database/) here grant permission for "alter" ddl command is missing.

Please update the document with alter command because the opencast 2 mysql script has alter table query (found when i dive into the script)

also created the account in the opencast jira to watch the issue.

Thanks

Sathish Thangathurai.

[Karen Dolan]

Hi Sathish,

Thanks for the help. I was following your suggestion and in my local machine i’ve tested with sample video and it have been successfully running. 

Great!

I hope this discussion will help to newbie from different timezone who need opencast.

Thank you for exposing the issue.

documentation (http://docs.opencast.org/latest/admin/configuration/database/) … grant permission for “alter” ddl command is missing.

Please update the document with alter command because the opencast 2 mysql script has alter table query (found when i dive into the script)

That is a good catch. Ironically, a fix is in review to remove the “alter” on creating the new matterhorn database table [1]. However, “matterhorn” still needs “alter” rights to run the database upgrade scripts. I added a ticket for updating the documentation  [2].

Thank you for persisting through this build!

Best Regards,

Karen

[1] https://bitbucket.org/opencast-community/matterhorn/pull-requests/562/mh-10588-make-constrains-consistent/diff

[2] https://opencast.jira.com/browse/MH-11043