2018-10-11 04:47:14 INFO main:KyloVersionUtil:98 - finding version information from /opt/kylo/kylo-services/conf/version.txt 2018-10-11 04:47:14 INFO main:KyloVersionUtil:106 - loaded Kylo version file: 0.9.1.1 build Time: 2018-07-06 23:32 2018-10-11 04:47:20 INFO main:KyloServerApplication:71 - Kylo v0.9.1.1 is up to date. Starting the application. 2018-10-11 04:47:26 INFO main:KyloServerApplication:664 - The following profiles are active: nifi-v1.2,auth-kylo,auth-file,search-esr,jms-activemq,auth-spark,native 2018-10-11 04:47:45 WARN localhost-startStop-1:ConnectionPool:180 - maxIdle is larger than maxActive, setting maxIdle to: 30 2018-10-11 04:47:46 WARN localhost-startStop-1:JavaTypeDescriptorRegistry:118 - Could not find matching type descriptor for requested Java class [java.util.List]; using fallback 2018-10-11 04:47:46 WARN localhost-startStop-1:JavaTypeDescriptorRegistry:118 - Could not find matching type descriptor for requested Java class [java.util.List]; using fallback 2018-10-11 04:47:46 WARN localhost-startStop-1:JavaTypeDescriptorRegistry:118 - Could not find matching type descriptor for requested Java class [java.security.Principal]; using fallback 2018-10-11 04:47:47 INFO localhost-startStop-1:ModeShapeEngineConfig:135 - Starting ModeShape engine... 2018-10-11 04:47:47 INFO localhost-startStop-1:ModeShapeEngineConfig:137 - ModeShape engine started 2018-10-11 04:47:47 INFO localhost-startStop-1:ModeShapeEngineConfig:118 - ModeShape indexing configured 2018-10-11 04:47:48 INFO localhost-startStop-1:HikariDataSource:70 - HikariPool-0 - is starting. 2018-10-11 04:47:50 WARN localhost-startStop-1:RepositoryConfiguration:86 - The field name is not present on com.thinkbiganalytics.metadata.modeshape.security.SpringAuthenticationProvider or any of its super types 2018-10-11 04:47:50 WARN localhost-startStop-1:RepositoryConfiguration:86 - The field name is not present on com.thinkbiganalytics.metadata.modeshape.security.OverrideAuthenticationProvider or any of its super types 2018-10-11 04:47:50 WARN localhost-startStop-1:RepositoryConfiguration:86 - The field name is not present on com.thinkbiganalytics.metadata.modeshape.security.AdminAuthenticationProvider or any of its super types 2018-10-11 04:47:51 INFO localhost-startStop-1:KyloEsIndexProvider:53 - Initialized Elasticsearch provider for ModeShape 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d648c4d97d9-2d06-4e9b-80c6-cfb249b4ce61 (Expected 200/201): 201 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d648c4d97d9-2d06-4e9b-80c6-cfb249b4ce61 (Expected 200/201): 200 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d648c4d97d9-2d06-4e9b-80c6-cfb249b4ce61 (Expected 200/201): 200 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d648c4d97d9-2d06-4e9b-80c6-cfb249b4ce61 (Expected 200/201): 200 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d649747e0fa-3834-43ad-971a-d68c0c552cbd (Expected 200/201): 201 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d649747e0fa-3834-43ad-971a-d68c0c552cbd (Expected 200/201): 200 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d649747e0fa-3834-43ad-971a-d68c0c552cbd (Expected 200/201): 200 2018-10-11 04:47:54 INFO modeshape-reindexing-5-thread-1:KyloEsClient:300 - Indexing result for feed id de508797505d649747e0fa-3834-43ad-971a-d68c0c552cbd (Expected 200/201): 200 2018-10-11 04:47:55 INFO localhost-startStop-1:JerseyRestClient:219 - Created new Jersey Client without SSL connecting to http://nifi-devstack.net:8080 2018-10-11 04:47:55 INFO localhost-startStop-1:AbstractCacheBackedProvider:210 - Populating Cache for com.thinkbiganalytics.metadata.jpa.feed.security.JpaFeedOpsAccessControlProvider 2018-10-11 04:47:55 INFO localhost-startStop-1:FeedAclCache:97 - FeedAclCache populated. 2018-10-11 04:47:55 INFO localhost-startStop-1:AbstractCacheBackedProvider:216 - Time to populate com.thinkbiganalytics.metadata.jpa.feed.security.JpaFeedOpsAccessControlProvider Cache 97 ms 2018-10-11 04:47:56 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d649dd99443-8fa9-4730-9203-725cbbad88be (Expected 200/201): 201 2018-10-11 04:47:56 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d649dd99443-8fa9-4730-9203-725cbbad88be (Expected 200/201): 200 2018-10-11 04:47:56 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d649dd99443-8fa9-4730-9203-725cbbad88be (Expected 200/201): 200 2018-10-11 04:47:57 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d649dd99443-8fa9-4730-9203-725cbbad88be (Expected 200/201): 200 2018-10-11 04:47:57 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d6493f186fc-7deb-45f1-aad5-2cbcc009174c (Expected 200/201): 201 2018-10-11 04:47:57 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d6493f186fc-7deb-45f1-aad5-2cbcc009174c (Expected 200/201): 200 2018-10-11 04:47:57 INFO modeshape-reindexing-5-thread-1:KyloEsClient:183 - Indexing result for category id de508797505d6493f186fc-7deb-45f1-aad5-2cbcc009174c (Expected 200/201): 200 2018-10-11 04:47:58 INFO localhost-startStop-1:AbstractCacheBackedProvider:210 - Populating Cache for com.thinkbiganalytics.metadata.jpa.feed.OpsFeedManagerFeedProvider 2018-10-11 04:47:58 INFO localhost-startStop-1:AbstractCacheBackedProvider:216 - Time to populate com.thinkbiganalytics.metadata.jpa.feed.OpsFeedManagerFeedProvider Cache 34 ms 2018-10-11 04:47:58 INFO localhost-startStop-1:ActiveMqConfig:87 - Connecting to ActiveMQ as kylo 2018-10-11 04:47:58 INFO localhost-startStop-1:ActiveMqConfig:75 - Setup ActiveMQ ConnectionFactory for ssl://jms-devstack.net:61617 2018-10-11 04:47:59 INFO localhost-startStop-1:ClusterAwareDtoCache:189 - Populating Cache for ServiceLevelAgreementDescriptionCache 2018-10-11 04:47:59 INFO localhost-startStop-1:ClusterAwareDtoCache:195 - Time to populate ServiceLevelAgreementDescriptionCache Cache 7 ms 2018-10-11 04:48:00 INFO localhost-startStop-1:ElasticSearchRestService:78 - Search engine: Elasticsearch (rc) 2018-10-11 04:48:05 INFO pool-6-thread-1:NifiFlowCacheImpl:247 - Check and Initialize NiFi Flow Cache. Kylo up to date:true, NiFi Connected:true, Cache needs loading:true 2018-10-11 04:48:05 INFO pool-6-thread-1:NifiFlowCacheImpl:423 - Attempting to build the NiFiFlowCache 2018-10-11 04:48:05 INFO pool-6-thread-1:NifiFlowCacheImpl:347 - Rebuilding the NiFi Flow Cache. Starting NiFi Flow Inspection with 1 threads ... 2018-10-11 04:48:07 INFO Thread-15:NiFiFlowInspectorManager:189 - Completed NiFi inspection of process groups 2018-10-11 04:48:07 INFO pool-6-thread-1:NifiFlowCacheImpl:369 - NiFi Flow Inspection took 1765 ms with 1 threads for 2 feeds, 67 processors and 100 connections 2018-10-11 04:48:07 INFO pool-6-thread-1:NifiFlowCacheImpl:372 - Adding 4 Root Connections to the niFiObjectCache 2018-10-11 04:48:07 INFO pool-6-thread-1:NifiFlowCacheImpl:381 - Successfully built NiFi Flow Cache 2018-10-11 04:48:07 INFO pool-6-thread-1:StreamingFeedJmsNotificationService:173 - Notify JMS topic: kylo.nifi-streaming-feeds of streaming feeds StreamingFeedListHolder{streamingFeedListData size=0, entireList=true, mode=ADD} 2018-10-11 04:48:07 INFO pool-6-thread-1:NifiFlowCacheImpl:426 - Successfully built the NiFiFlowCache 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:97 - Indexing users and groups 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:99 - Finished indexing users 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:101 - Finished indexing groups 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:85 - Starting post metadata config action: com.thinkbiganalytics.metadata.modeshape.security.CheckEntityAccessControlAction... 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:87 - Finished post metadata config action: com.thinkbiganalytics.metadata.modeshape.security.CheckEntityAccessControlAction 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:85 - Starting post metadata config action: com.thinkbiganalytics.feedmgr.config.HistoryDataReindexingFeedsAvailableCache... 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:87 - Finished post metadata config action: com.thinkbiganalytics.feedmgr.config.HistoryDataReindexingFeedsAvailableCache 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:85 - Starting post metadata config action: com.thinkbiganalytics.metadata.sla.DefaultServiceLevelAgreementScheduler... 2018-10-11 04:48:11 WARN main:HibernateJpaDialect:347 - JDBC Connection to reset not identical to originally prepared Connection - please make sure to use connection release mode ON_CLOSE (the default) and to run against Hibernate 4.2+ (or switch HibernateJpaDialect's prepareConnection flag to false 2018-10-11 04:48:11 INFO main:DefaultServiceLevelAgreementScheduler:103 - PostMetadataConfigAction called for DefaultServiceLevelAgreementScheduler. About to schedule the SLA's 2018-10-11 04:48:11 INFO main:DefaultServiceLevelAgreementScheduler:108 - About to schedule 0 SLA's 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:87 - Finished post metadata config action: com.thinkbiganalytics.metadata.sla.DefaultServiceLevelAgreementScheduler 2018-10-11 04:48:11 INFO main:MetadataJcrConfigurator:85 - Starting post metadata config action: com.thinkbiganalytics.feedmgr.service.datasource.DatasourceService... 2018-10-11 04:48:16 INFO main:MetadataJcrConfigurator:87 - Finished post metadata config action: com.thinkbiganalytics.feedmgr.service.datasource.DatasourceService 2018-10-11 04:48:16 INFO main:MetadataJcrConfigurator:85 - Starting post metadata config action: com.thinkbiganalytics.metadata.modeshape.MetadataJcrConfig$1... 2018-10-11 04:48:16 INFO main:MetadataJcrConfigurator:87 - Finished post metadata config action: com.thinkbiganalytics.metadata.modeshape.MetadataJcrConfig$1 2018-10-11 04:48:16 INFO main:MetadataJcrConfigurator:85 - Starting post metadata config action: com.thinkbiganalytics.metadata.modeshape.security.EnsureServicesAccessControlAction... 2018-10-11 04:48:16 INFO main:EnsureServicesAccessControlAction:57 - Ensuring the Services prototype access control permissions are members of the actual Services access control node 2018-10-11 04:48:17 INFO main:MetadataJcrConfigurator:87 - Finished post metadata config action: com.thinkbiganalytics.metadata.modeshape.security.EnsureServicesAccessControlAction 2018-10-11 04:48:24 INFO main:ReflectionPolicyAnnotationDiscoverer:49 - Found 0 classes annotated with interface com.thinkbiganalytics.classnameregistry.ClassNameChange 2018-10-11 04:48:26 WARN main:VelocityAutoConfiguration:79 - Cannot find template location: classpath:/templates/ (please add some templates, check your Velocity configuration, or set spring.velocity.checkTemplateLocation=false) 2018-10-11 04:48:28 INFO kylo-startup pool-1:DefaultServicesApplicationStartup:113 - Running startup listener NifiFlowCacheImpl 2018-10-11 04:48:28 INFO kylo-startup pool-2:DefaultServicesApplicationStartup:113 - Running startup listener ValidationStartupListener 2018-10-11 04:48:28 INFO kylo-startup pool-3:DefaultServicesApplicationStartup:113 - Running startup listener StandardizationStartupListener 2018-10-11 04:48:28 INFO kylo-startup pool-0:DefaultServicesApplicationStartup:113 - Running startup listener PreconditionPolicyRuleCache 2018-10-11 04:48:28 INFO kylo-startup pool-4:DefaultServicesApplicationStartup:113 - Running startup listener FeedFailureServiceStatusStartupListener 2018-10-11 04:48:28 INFO kylo-startup pool-5:DefaultServicesApplicationStartup:113 - Running startup listener ClusterServiceStartupListener 2018-10-11 04:48:28 INFO kylo-startup pool-0:ReflectionPolicyAnnotationDiscoverer:49 - Found 2 classes annotated with interface com.thinkbiganalytics.policy.precondition.PreconditionPolicy 2018-10-11 04:48:28 INFO kylo-startup pool-3:ReflectionPolicyAnnotationDiscoverer:49 - Found 11 classes annotated with interface com.thinkbiganalytics.policy.standardization.Standardizer 2018-10-11 04:48:28 INFO kylo-startup pool-2:ReflectionPolicyAnnotationDiscoverer:49 - Found 13 classes annotated with interface com.thinkbiganalytics.policy.validation.Validator 2018-10-11 04:48:28 INFO main:KyloServerApplication:57 - Started KyloServerApplication in 67.808 seconds (JVM running for 75.022) 2018-10-11 04:48:49 WARN http-nio-8420-exec-1:Errors:191 - The following warnings have been detected: WARNING: The (sub)resource method findJobs in com.thinkbiganalytics.jobrepo.rest.controller.JobsRestController contains empty path annotation. WARNING: The (sub)resource method getAssessments in com.thinkbiganalytics.jobrepo.rest.controller.ServiceLevelAssessmentsController contains empty path annotation. WARNING: The (sub)resource method getProperties in com.thinkbiganalytics.feedmgr.rest.controller.FeedMetadataPropertiesRestController contains empty path annotation. 2018-10-11 04:49:06 ERROR http-nio-8420-exec-10:ElasticSearchRestService:216 - An error occurred during submitting search request for query: {test}, start: {0}, size: {10} org.elasticsearch.client.ResponseException: POST http://elasticsearch-devstack.net:80_search?ignore_unavailable=true&pretty=true: HTTP/1.1 400 Bad Request 400 Bad Request

400 Bad Request

at org.elasticsearch.client.RestClient$1.completed(RestClient.java:354) at org.elasticsearch.client.RestClient$1.completed(RestClient.java:343) at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:119) at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:177) at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:436) at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:326) at org.apache.http.impl.nio.client.InternalRequestExecutor.inputReady(InternalRequestExecutor.java:83) at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) at java.lang.Thread.run(Thread.java:748) 2018-10-11 04:49:06 WARN http-nio-8420-exec-10:ElasticSearchRestService:188 - Search execution produced null response