overload is not working

266 views
Skip to first unread message

mhps...@gmail.com

unread,
Oct 5, 2018, 3:16:05 PM10/5/18
to Druid User
2018-10-05T19:07:18,426 ERROR [qtp209667159-108] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2018-10-05T19:07:18,426 WARN [qtp209667159-108] org.eclipse.jetty.servlet.ServletHandler - /druid/indexer/v1/workers
io.druid.java.util.common.ISE: Can't find indexingService, did you configure druid.selectors.indexing.serviceName same as druid.service at overlord?
        at io.druid.server.http.OverlordProxyServlet.rewriteTarget(OverlordProxyServlet.java:57) ~[druid-server-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at org.eclipse.jetty.proxy.ProxyServlet.service(ProxyServlet.java:63) ~[jetty-proxy-9.3.19.v20170502.jar:9.3.19.v20170502]
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) ~[javax.servlet-api-3.1.0.jar:3.1.0]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:848) ~[jetty-servlet-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1772) ~[jetty-servlet-9.3.19.v20170502.jar:9.3.19.v20170502]
        at io.druid.server.http.RedirectFilter.doFilter(RedirectFilter.java:72) ~[druid-server-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) ~[jetty-servlet-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) [jetty-servlet-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) [jetty-servlet-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.Server.handle(Server.java:534) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) [jetty-server-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) [jetty-io-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) [jetty-io-9.3.19.v20170502.jar:9.3.19.v20170502]
        at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) [jetty-io-9.3.19.v20170502.jar:9.3.19.v20170502]

Gian Merlino

unread,
Oct 5, 2018, 4:40:51 PM10/5/18
to druid...@googlegroups.com
That error probably means the overlord didn't start up. Its logs might have something interesting in them.

Gian


--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/930ec437-3ff3-4902-8a06-649a72fa3944%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

mhps...@gmail.com

unread,
Oct 5, 2018, 4:59:16 PM10/5/18
to Druid User
Everything is working fine.

But this is error i am getting and because of this issue indexing is not working and even overlord console also not working. i think this is probably missing some configuration from zookeeper.

/druid/discovery/druid:overlord/ does not have anything.

Gian Merlino

unread,
Oct 5, 2018, 6:47:40 PM10/5/18
to druid...@googlegroups.com
Have you customized any of the druid.service configs? If not, they should be ok out of the box. If the overlord console is not working, and you are getting this error, then both of those seem to indicate the overlord has some issue. I would double check its logs to make sure it's ok. Or its status endpoint at http://OVERLORD:8090/status.

Gian


mhps...@gmail.com

unread,
Oct 6, 2018, 3:42:02 AM10/6/18
to Druid User


http://overloard:8090/status 

{"version":"0.10.1.2.6.5.0-292","modules":[{"name":"io.druid.query.aggregation.datasketches.theta.SketchModule","artifact":"druid-datasketches","version":"0.10.1.2.6.5.0-292"},{"name":"io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule","artifact":"druid-datasketches","version":"0.10.1.2.6.5.0-292"},{"name":"io.druid.storage.hdfs.HdfsStorageDruidModule","artifact":"druid-hdfs-storage","version":"0.10.1.2.6.5.0-292"},{"name":"io.druid.indexing.kafka.KafkaIndexTaskModule","artifact":"druid-kafka-indexing-service","version":"0.10.1.2.6.5.0-292"},{"name":"io.druid.metadata.storage.mysql.MySQLMetadataStorageModule","artifact":"mysql-metadata-storage","version":"0.10.1.2.6.5.0-292"}],"memory":{"maxMemory":517472256,"totalMemory":517472256,"freeMemory":451039504,"usedMemory":66432752}}

this is output .

i did some changes in zookeeper /druid/discovery/druid:overlord/ 
here i have run following command.


 create /druid/discovery/druid:overlord/7175888f-4a66-4752-914b-ba4dd30eb0e4 {"name":"druid:overlord","id":"7175888f-4a66-4752-914b-ba4dd30eb0e4","address":"host","port":8090,"sslPort":null,"payload":null,"registrationTimeUTC":1538459763281,"serviceType":"DYNAMIC","uriSpec":null}

after that i am getting following error in router log

2018-10-06T07:34:39,401 ERROR [CoordinatorRuleManager-Exec--0] io.druid.server.router.CoordinatorRuleManager - Exception while polling for rules
com.fasterxml.jackson.databind.JsonMappingException: No content to map due to end-of-input
 at [Source: ; line: 1, column: 1]
        at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148) ~[jackson-databind-2.4.6.jar:2.4.6]
        at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:3110) ~[jackson-databind-2.4.6.jar:2.4.6]
        at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3051) ~[jackson-databind-2.4.6.jar:2.4.6]
        at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2168) ~[jackson-databind-2.4.6.jar:2.4.6]
        at io.druid.server.router.CoordinatorRuleManager.poll(CoordinatorRuleManager.java:175) [druid-server-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at io.druid.server.router.CoordinatorRuleManager$1.run(CoordinatorRuleManager.java:115) [druid-server-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at io.druid.java.util.common.concurrent.ScheduledExecutors$1.call(ScheduledExecutors.java:65) [java-util-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at io.druid.java.util.common.concurrent.ScheduledExecutors$1.call(ScheduledExecutors.java:61) [java-util-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at io.druid.java.util.common.concurrent.ScheduledExecutors$2.run(ScheduledExecutors.java:102) [java-util-0.10.1.2.6.5.0-292.jar:0.10.1.2.6.5.0-292]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_112]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_112]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_112]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_112]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_112]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_112]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]

Reply all
Reply to author
Forward
0 new messages