We are seeing proxy put failures during zone expansion. Here are the relevant logs,
ERROR [voldemort-niosocket-server11] voldemort.server.niosocket.AsyncRequestHandler -
java.lang.NullPointerException
ERROR [voldemort-proxy-put-thread24] voldemort.store.rebalancing.AsyncProxyPutTask - Exception in proxy put for proxyNode: 8 from node:1 on key XYZ async Version:version(1:1, 8:6) ts:123456
voldemort.store.UnreachableStoreException: Failure while checking out socket for hostA:6099:
at voldemort.store.socket.clientrequest.ClientRequestExecutorPool.checkout(ClientRequestExecutorPool.java:199)
at voldemort.store.socket.SocketStore.request(SocketStore.java:279)
at voldemort.store.socket.SocketStore.put(SocketStore.java:246)
at voldemort.store.socket.SocketStore.put(SocketStore.java:63)
at voldemort.store.rebalancing.AsyncProxyPutTask.run(AsyncProxyPutTask.java:80)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
What are the parameters which define the proxy put timeout? Also, the NPE in bold is not very helpful, can someone please elaborate on it? In general, how can we avoid it in the future?