Store gate way is working but querier couldn't fetch store metedata
648 views
Skip to first unread message
pradeep kumar
Apr 5, 2021, 5:55:12 PM4/5/21
to Prometheus Users
Error Logs on Thanos Querier:
level=warn ts=2021-04-05T21:49:49.905511721Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:49:54.90596848Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:49:59.907422889Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:04.907983886Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:09.908591215Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:14.90931006Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:19.909676101Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:24.910347299Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:29.915045963Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=info ts=2021-04-05T21:50:30.935406499Z caller=storeset.go:463 component=storeset msg="adding new storeAPI to query storeset" address=172.30.248.120:19891 extLset=
level=warn ts=2021-04-05T21:49:49.905511721Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:49:54.90596848Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:49:59.907422889Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:04.907983886Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:09.908591215Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:14.90931006Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:19.909676101Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:24.910347299Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=warn ts=2021-04-05T21:50:29.915045963Z caller=storeset.go:570 component=storeset msg="update of store node failed" err="getting metadata: fetching store info from 172.30.248.120:19891: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=172.30.248.120:19891 level=info ts=2021-04-05T21:50:30.935406499Z caller=storeset.go:463 component=storeset msg="adding new storeAPI to query storeset" address=172.30.248.120:19891 extLset=
Reply all
Reply to author
Forward
0 new messages