Need help getting OpenTSDB 2.0 to load the Skyline plugin.

[Adam Steffes]

I dit a 'git pull' of the next branch tonight as well as building the Skyline publisher plugin from https://github.com/gutefrage/OpenTsdbSkylinePublisher 

Recompiling the plugin to capture some output returns a lot of "already added, skipping" as we'd expect but here's the output anyway:

adam.steffes@ws-z0-110119:~/git/OpenTsdbSkylinePublisher$ /usr/bin/mvn assembly:single

[INFO] Scanning for projects...

[WARNING] 

[WARNING] Some problems were encountered while building the effective model for de.gf:TsdbSkylinePublisher:jar:1.0-SNAPSHOT

[WARNING] 'dependencies.dependency.systemPath' for net.opentsdb:next:jar should not point at files within the project directory, ${basedir}/tsdb-2.0.0.jar will be unresolvable by dependent projects @ line 68, column 25

[WARNING] 'dependencies.dependency.systemPath' for net.opentsdb:next:jar refers to a non-existing file /home/adam.steffes/git/OpenTsdbSkylinePublisher/tsdb-2.0.0.jar @ line 68, column 25

[WARNING] 

[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.

[WARNING] 

[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.

[WARNING] 

[INFO]                                                                         

[INFO] ------------------------------------------------------------------------

[INFO] Building TsdbSkylinePublisher 1.0-SNAPSHOT

[INFO] ------------------------------------------------------------------------

[INFO] 

[INFO] --- maven-assembly-plugin:2.2-beta-5:single (default-cli) @ TsdbSkylinePublisher ---

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] com/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] org/apache/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/maven/org.slf4j/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] Building jar: /home/adam.steffes/git/OpenTsdbSkylinePublisher/target/TsdbSkylinePublisher-1.0-SNAPSHOT-jar-with-dependencies.jar

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] com/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] org/apache/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] META-INF/maven/org.slf4j/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] org/ already added, skipping

[INFO] META-INF/ already added, skipping

[INFO] META-INF/MANIFEST.MF already added, skipping

[INFO] META-INF/maven/ already added, skipping

[INFO] ------------------------------------------------------------------------

[INFO] BUILD SUCCESS

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 4.020s

[INFO] Finished at: Thu Oct 03 17:32:44 PDT 2013

[INFO] Final Memory: 7M/123M

[INFO] ------------------------------------------------------------------------

I copied the tsdb-2.0.0.jar file from the opentsdb code tree over to the plugin tree to fix the "refers to a non-existing file" error, but that didn't help, in case you were wondering.

My opentsdb.conf includes entries to load the plugin like so:

tsd.core.plugin_path = /home/adam.steffes/git/OpenTsdbSkylinePublisher/target/

tsd.rtpublisher.enable = true

tsd.rtpublisher.plugin = net.gutefrage.tsdb.SkylinePublisher

tsd.plugin.skyline.port = 2025

tsd.plugin.skyline.host = 10.45.110.112

I also tried other values for tsd.core.plugin_path like  /home/adam.steffes/git/OpenTsdbSkylinePublisher, or moving the plugin directory into ~/git/opentsdb/plugins, to no avail. I always get something like this when I start-up the TSD now:

adam.steffes@ws-z0-110119:~/git/opentsdb$ ./build/tsdb tsd --config=src/opentsdb.conf

2013-10-03 20:24:15,914 INFO  [main] TSDMain: Starting.

2013-10-03 20:24:15,918 INFO  [main] TSDMain: net.opentsdb 2.0.0 built at revision 74324b1 (MODIFIED)

2013-10-03 20:24:15,918 INFO  [main] TSDMain: Built on 2013/10/04 00:29:44 +0000 by adam.steffes@ws-z0-110119:/home/adam.steffes/git/opentsdb/build

2013-10-03 20:24:15,934 INFO  [main] Config: Successfully loaded configuration file: src/opentsdb.conf

2013-10-03 20:24:16,031 WARN  [main] PluginLoader: Unable to locate any plugins of the type: net.opentsdb.tsd.RTPublisher

2013-10-03 20:24:16,036 INFO  [main] TSDB: Flushing compaction queue

Exception in thread "main" java.lang.RuntimeException: Initialization failed

at net.opentsdb.tools.TSDMain.main(TSDMain.java:182)

Caused by: java.lang.IllegalArgumentException: Unable to locate real time publisher plugin: net.gutefrage.tsdb.SkylinePublisher

at net.opentsdb.core.TSDB.initializePlugins(TSDB.java:194)

at net.opentsdb.tools.TSDMain.main(TSDMain.java:144)

Can anyone help me figure out why the TSD won't load the plugin? I know it appears it can't find it, so I'm wondering if my opentsdb.conf is somehow incorrect.

Thanks,

Adam

[Florian Pfeiffer]

I haven't touched the plugin for quite some while, so I wouldn't be surprised when some things have changed and it's not working with the current version. Let me have a look...

[Edmond dela Cruz]

I'm putting this here even if it is long overdue. If the plugin was built with "mvn assembly:single", the output jar doesn't contain the class of the SkylinePublisher. You can verify this by extracting the jar file. 

I build mine using "mvn install". 

[ManOLamancha]

On Sunday, April 1, 2018 at 7:54:55 PM UTC-7, Edmond dela Cruz wrote:

I'm putting this here even if it is long overdue. If the plugin was built with "mvn assembly:single", the output jar doesn't contain the class of the SkylinePublisher. You can verify this by extracting the jar file. 

I build mine using "mvn install".

It should still be compatible. Dod you place the JAR in a path defined in the "tsd.core.plugin_path" config for your TSD? It has to read from there.