Nifi connectivity issue

[Yuvaraj G]

Installed 8.4 and installed separate nifi cluster (3 node), configured the nifi url details as below on the application.properties on kylo services.

While login into the kylo UI, under the dashboard i am seeing the nifi connection issue.

nifi is running and listening on https port 9091.

Getting the below error on the nifi-app.log

Nifis is not starting up...

2017-12-05 19:00:44,249 INFO [main] o.eclipse.jetty.server.AbstractConnector Started ServerConnector@65e639f2{SSL,[ssl, http/1.1]}{kylo-pre01-nifi-node1:9091}

2017-12-05 19:00:44,249 INFO [main] org.eclipse.jetty.server.Server Started @17810ms

2017-12-05 19:00:44,249 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down.

org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.

        at org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:88)

        at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:876)

        at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532)

        at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:839)

Caused by: java.lang.RuntimeException: java.lang.IllegalStateException: The specified implementation class 'com.thinkbiganalytics.nifi.provenance.repo.KyloPersistentProvenanceEventRepository' is not known to this nifi.

        at org.apache.nifi.controller.FlowController.createProvenanceRepository(FlowController.java:880)

        at org.apache.nifi.controller.FlowController.<init>(FlowController.java:480)

        ... 44 common frames omitted

2017-12-05 19:00:32,128 INFO [main] org.apache.nifi.nar.NarClassLoaders Loaded NAR file: /var/lib/nifi/work/nar/extensions/nifi-couchbase-nar-1.2.0.3.0.2.0-76.nar-unpacked as class loader org.apache.nifi.nar.NarClassLoader[/var/lib/nifi/work/nar/extensions/nifi-couchbase-nar-1.2.0.3.0.2.0-76.nar-unpacked]

...skipping...

attached the screenshot. 

Verify NiFi is running and try again

[Greg Hart]

Hi Yuvaraj,

Please ensure that you've repeated step 7 of the below instructions on every NiFi node:

http://kylo.readthedocs.io/en/latest/installation/ManualDeploymentGuide.html#step-7-install-nifi

[Yuvaraj G]

After creating some link files, now i am getting the below error on nifi logs.

2017-12-05 20:45:27,805 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.couchbase.PutCouchbaseKey is bundled with its referenced Controller Service APIs org.apache.nifi.couchbase.CouchbaseClusterControllerService. The service APIs should not be bundled with component implementations that reference it.

2017-12-05 20:45:27,808 WARN [main] org.apache.nifi.nar.ExtensionManager Controller Service org.apache.nifi.couchbase.CouchbaseClusterService is bundled with its supporting APIs org.apache.nifi.couchbase.CouchbaseClusterControllerService. The service APIs should not be bundled with the implementations.

2017-12-05 20:45:28,042 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.PutGCSObject is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.

2017-12-05 20:45:28,044 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.FetchGCSObject is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.

2017-12-05 20:45:28,045 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.DeleteGCSObject is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.

2017-12-05 20:45:28,047 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.ListGCSBucket is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.

2017-12-05 20:45:28,053 WARN [main] org.apache.nifi.nar.ExtensionManager Controller Service org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsControllerService is bundled with its supporting APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with the implementations.

2017-12-05 20:45:28,854 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down.

java.lang.IllegalStateException: Attempt was made to load com.thinkbiganalytics.nifi.provenance.repo.KyloPersistentProvenanceEventRepository from default:kylo-nifi-provenance-repo-v1-nar:unversioned but that class name is already loaded/registered from default:kylo-nifi-provenance-repo-v1.2-nar:unversioned and multiple versions are not supported for this type

        at org.apache.nifi.nar.ExtensionManager.registerServiceClass(ExtensionManager.java:275)

        at org.apache.nifi.nar.ExtensionManager.loadExtensions(ExtensionManager.java:167)

        at org.apache.nifi.nar.ExtensionManager.discoverExtensions(ExtensionManager.java:113)

        at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:699)

        at org.apache.nifi.NiFi.<init>(NiFi.java:160)

        at org.apache.nifi.NiFi.main(NiFi.java:267)

[Greg Hart]

Hi Yuvaraj,

The files have a version number indicating what version of NiFi they support. If you have NiFi 1.0 or 1.1 then you should use the 'v1' files. If you have NiFi 1.2, 1.3, or 1.4 then you should use the 'v1.2' files. Please ensure that you've only added the correct file versions to NiFi's lib folder.

[Yuvaraj G]

Thanks it works..!