Hiveserver2 turns off after queries
107 views
Skip to first unread message
ranaivoson...@gmail.com
Dec 2, 2020, 3:29:20 AM12/2/20
to MR3
Hello,
after working many times on my env, I've gotten the error below:
2020-12-02T08:28:57,632 ERROR [f3a6fd4d-c3c3-4f4e-867e-ea9b6bff8525 HiveServer2-Handler-Pool: Thread-94] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:36:23,905 ERROR [7b963d42-a3fe-4f76-8288-28f7005aea22 HiveServer2-Handler-Pool: Thread-112] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:43:18,223 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:50:07,988 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:57:42,180 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:04:36,719 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:11:57,146 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:18:46,001 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:26:09,531 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:35:59,024 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:42:52,501 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:49:42,320 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:57:05,052 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T10:37:32,501 ERROR [79e45158-88eb-4b43-a042-bbca89c54daf HiveServer2-Handler-Pool: Thread-61] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T10:53:00,183 ERROR [Thread-7] thrift.ThriftCLIService: Error starting HiveServer2: could not start ThriftBinaryCLIService
org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:10000.
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:109) ~[hive-exec-2.3.0.jar:2.3.0]
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:91) ~[hive-exec-2.3.0.jar:2.3.0]
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:87) ~[hive-exec-2.3.0.jar:2.3.0]
at org.apache.hadoop.hive.common.auth.HiveAuthUtils.getServerSocket(HiveAuthUtils.java:87) ~[hive-common-2.3.0.jar:2.3.0]
at org.apache.hive.service.cli.thrift.ThriftBinaryCLIService.run(ThriftBinaryCLIService.java:78) ~[hive-service-2.3.0.jar:2.3.0]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]
Caused by: java.net.BindException: Address already in use (Bind failed)
at java.net.PlainSocketImpl.socketBind(Native Method) ~[?:1.8.0_221]
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387) ~[?:1.8.0_221]
at java.net.ServerSocket.bind(ServerSocket.java:375) ~[?:1.8.0_221]
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:106) ~[hive-exec-2.3.0.jar:2.3.0]
... 5 more
2020-12-02T10:53:00,336 ERROR [main] server.HiveServer2: Error starting Web UI:
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method) ~[?:1.8.0_221]
at sun.nio.ch.Net.bind(Net.java:433) ~[?:1.8.0_221]
at sun.nio.ch.Net.bind(Net.java:425) ~[?:1.8.0_221]
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) ~[?:1.8.0_221]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[?:1.8.0_221]
at org.eclipse.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:173) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:311) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:251) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:59) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.server.Server.doStart(Server.java:272) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:59) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.apache.hive.http.HttpServer.start(HttpServer.java:213) ~[hive-common-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:507) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:608) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:100) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:855) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:724) [hive-service-2.3.0.jar:2.3.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_221]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_221]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at org.apache.hadoop.util.RunJar.run(RunJar.java:221) [hadoop-common-2.7.4.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:136) [hadoop-common-2.7.4.jar:?]
2020-12-02T10:58:57,925 ERROR [3de3faae-91d1-479c-8158-a631e3ce6e01 HiveServer2-Handler-Pool: Thread-59] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:36:23,905 ERROR [7b963d42-a3fe-4f76-8288-28f7005aea22 HiveServer2-Handler-Pool: Thread-112] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:43:18,223 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:50:07,988 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T08:57:42,180 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:04:36,719 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:11:57,146 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:18:46,001 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:26:09,531 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:35:59,024 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:42:52,501 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:49:42,320 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T09:57:05,052 ERROR [faeb56e5-9c31-4fd9-b90f-5e54d0d0d859 HiveServer2-Handler-Pool: Thread-128] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T10:37:32,501 ERROR [79e45158-88eb-4b43-a042-bbca89c54daf HiveServer2-Handler-Pool: Thread-61] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
2020-12-02T10:53:00,183 ERROR [Thread-7] thrift.ThriftCLIService: Error starting HiveServer2: could not start ThriftBinaryCLIService
org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:10000.
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:109) ~[hive-exec-2.3.0.jar:2.3.0]
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:91) ~[hive-exec-2.3.0.jar:2.3.0]
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:87) ~[hive-exec-2.3.0.jar:2.3.0]
at org.apache.hadoop.hive.common.auth.HiveAuthUtils.getServerSocket(HiveAuthUtils.java:87) ~[hive-common-2.3.0.jar:2.3.0]
at org.apache.hive.service.cli.thrift.ThriftBinaryCLIService.run(ThriftBinaryCLIService.java:78) ~[hive-service-2.3.0.jar:2.3.0]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]
Caused by: java.net.BindException: Address already in use (Bind failed)
at java.net.PlainSocketImpl.socketBind(Native Method) ~[?:1.8.0_221]
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387) ~[?:1.8.0_221]
at java.net.ServerSocket.bind(ServerSocket.java:375) ~[?:1.8.0_221]
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:106) ~[hive-exec-2.3.0.jar:2.3.0]
... 5 more
2020-12-02T10:53:00,336 ERROR [main] server.HiveServer2: Error starting Web UI:
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method) ~[?:1.8.0_221]
at sun.nio.ch.Net.bind(Net.java:433) ~[?:1.8.0_221]
at sun.nio.ch.Net.bind(Net.java:425) ~[?:1.8.0_221]
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) ~[?:1.8.0_221]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[?:1.8.0_221]
at org.eclipse.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:173) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:311) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:251) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:59) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.server.Server.doStart(Server.java:272) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:59) ~[jetty-all-7.6.0.v20120127.jar:7.6.0.v20120127]
at org.apache.hive.http.HttpServer.start(HttpServer.java:213) ~[hive-common-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:507) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:608) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:100) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:855) [hive-service-2.3.0.jar:2.3.0]
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:724) [hive-service-2.3.0.jar:2.3.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_221]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_221]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at org.apache.hadoop.util.RunJar.run(RunJar.java:221) [hadoop-common-2.7.4.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:136) [hadoop-common-2.7.4.jar:?]
2020-12-02T10:58:57,925 ERROR [3de3faae-91d1-479c-8158-a631e3ce6e01 HiveServer2-Handler-Pool: Thread-59] hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
Need help please, thank you so much.
Regards,
Andriatina
Sungwoo Park
Dec 2, 2020, 4:34:39 AM12/2/20
to MR3
Hi,
This error says that another process is using the port for Web UI.
2020-12-02T10:53:00,336 ERROR [main] server.HiveServer2: Error starting Web UI:
java.net.BindException: Address already in use
java.net.BindException: Address already in use
This occurs mostly when the previous instance of HiveServer2 has not terminated properly, so you could check if HiveServer2 is already running. The port is specified in:
<property>
<name>hive.server2.webui.port</name>
<value>10502</value>
</property>
From HiveConf.java:
HIVE_SERVER2_WEBUI_PORT("hive.server2.webui.port", 10002, "The port the HiveServer2 WebUI will listen on. This can be"
+ "set to 0 or a negative integer to disable the web UI"),
Web UI is not very useful for Hive-MR3, so it's okay to turn it off.
Cheers,
--- Sungwoo
Reply all
Reply to author
Forward
0 new messages