Minion Node service failing repeatedly due to GRPC Timeout

23 views

Skip to first unread message

Doraemon Nobi

unread,

Jan 13, 2026, 1:27:56 AM (3 days ago) Jan 13

to velociraptor-discuss

Hi Velociraptor team.

I have a velociraptor server deployment that has 2 nodes, one master and one minion node that are both present with the same network. Both are behind HA Proxy and we have a domain that is mapped to HA.

Now, the issue that I am facing is that my minion node service keeps on failing and the error that I see on minion is -
Jan 13 04:40:46 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:46Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:47 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:47Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:48 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:48Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:49 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:49Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:50 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:50Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:54 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:54Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:41:31 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:41:31Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:43:11 xyz-prod-velociraptor-minion-1 velociraptor[643501]: velociraptor: error: frontend: starting frontend: gRPC Timeout in Remote datastore
Jan 13 04:43:11 xyz-prod-velociraptor-minion-1 systemd[1]: velociraptor_server.service: Main process exited, code=exited, status=1/FAILURE
Jan 13 04:43:11 xyz-prod-velociraptor-minion-1 systemd[1]: velociraptor_server.service: Failed with result 'exit-code'.
Jan 13 04:43:11 xyz-prod-velociraptor-minion-1 systemd[1]: velociraptor_server.service: Consumed 14.027s CPU time.
Jan 13 04:40:48 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:48Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:49 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:49Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:50 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:50Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:40:54 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:40:54Z syncAllNotebooks gRPC Timeout in Remote datastore
Jan 13 04:41:31 xyz-prod-velociraptor-minion-1 velociraptor[643501]: [ERROR] 2026-01-13T04:41:31Z syncAllNotebooks gRPC Timeout in Remote datastore

And this is the error on master node –
Jan 13 04:36:06 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:36:06Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:36:06 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:36:06Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:36:06 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:36:06Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:36:06 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:36:06Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:36:06 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:36:06Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:43:11 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:43:11Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:43:11 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:43:11Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:43:11 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:43:11Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:43:11 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:43:11Z Scheduler: rpc error: code = Canceled desc = context canceled
Jan 13 04:43:11 xyz-prod-velociraptor-master velociraptor[87175]: [ERROR] 2026-01-13T04:43:11Z Scheduler: rpc error: code = Canceled desc = context canceled

Now due to this , master node remains un-affected “mostly” but the minion node does not stop which reduces the total frontends back to 1, but major issue is that the notebooks of the clients that were originally connected to minion node do not load.

I have tried to do the following –
1. Restarting the services multiple times.
2. Clearing up the hunts and their flows.

But none of it seems to work.

This is my master server config –
version:
name: velociraptor
version: 0.74.5
commit: "049040963"
build_time: "2025-07-03T16:12:10Z"
compiler: go1.23.2
system: linux
architecture: amd64
Client:
server_urls:
- https://<MASTER-IP>:7445/
- https://<MINION-IP>:7445/
ca_certificate: |
-----BEGIN CERTIFICATE-----
XYZ
-----END CERTIFICATE-----
nonce: XYZ
writeback_darwin: /etc/velociraptor.writeback.yaml
writeback_linux: /etc/velociraptor.writeback.yaml
writeback_windows: $ProgramFiles\Velociraptor\velociraptor.writeback.yaml
level2_writeback_suffix: .bak
tempdir_windows: $ProgramFiles\Velociraptor\Tools
max_poll: 60
nanny_max_connection_delay: 600
windows_installer:
service_name: Velociraptor
install_path: $ProgramFiles\Velociraptor\Velociraptor.exe
service_description: Velociraptor service
darwin_installer:
service_name: com.velocidex.velociraptor
install_path: /usr/local/sbin/velociraptor
version:
name: velociraptor
version: 0.74.5
commit: "049040963"
build_time: "2025-07-03T16:12:10Z"
compiler: go1.23.2
system: linux
architecture: amd64
server_version:
version: 0.74.5
commit: "049040963"
build_time: "2025-07-03T16:12:10Z"
use_self_signed_ssl: true
max_upload_size: 5242880
local_buffer:
memory_size: 52428800
disk_size: 1073741824
filename_linux: /var/tmp/Velociraptor_Buffer.bin
filename_windows: $TEMP/Velociraptor_Buffer.bin
filename_darwin: /var/tmp/Velociraptor_Buffer.bin
API:
bind_address: 192.168.10.206
bind_port: 8001
bind_scheme: tcp
pinned_gw_name: GRPC_GW
GUI:
bind_address: 0.0.0.0
bind_port: 8889
gw_certificate: |
-----BEGIN CERTIFICATE-----
XYZ
-----END CERTIFICATE-----
gw_private_key: |
-----BEGIN RSA PRIVATE KEY-----
XYZ
-----END RSA PRIVATE KEY-----
public_url: https://<MASTER-IP>:8889/
links:
- text: Documentation
url: https://docs.velociraptor.app/
icon_url: data:image/svg+xml;base64,<LINK>
type: sidebar
new_tab: true
initial_users:
- name: XYZ
password_hash: XYZ
password_salt: XYZ
authenticator:
type: Basic
CA:
private_key: |
-----BEGIN RSA PRIVATE KEY-----
XYZ
-----END RSA PRIVATE KEY-----
Frontend:
hostname: 192.168.10.206
bind_address: 0.0.0.0
bind_port: 7445
certificate: |
-----BEGIN CERTIFICATE-----
XYZ
-----END CERTIFICATE-----
private_key: |
-----BEGIN RSA PRIVATE KEY-----
XYZ
-----END RSA PRIVATE KEY-----
default_client_monitoring_artifacts:
- Generic.Client.Stats
GRPC_pool_max_size: 100
GRPC_pool_max_wait: 60
resources:
connections_per_second: 100
notifications_per_second: 30
max_upload_size: 10485760
expected_clients: 30000
ExtraFrontends:
- hostname: <MINION-IP>
bind_address: 0.0.0.0
bind_port: 7445
resources:
connections_per_second: 100
notifications_per_second: 30
max_upload_size: 10485760
expected_clients: 30000
Datastore:
location: /opt/velociraptor
filestore_directory: /opt/velociraptor
minion_implementation: RemoteFileDataStore
master_implementation: MemcacheFileDataStore
Logging:
output_directory: /opt/velociraptor/logs
separate_logs_per_component: true
debug:
disabled: true
info:
rotation_time: 604800
max_age: 31536000
error:
rotation_time: 604800
max_age: 31536000
Monitoring:
bind_address: 0.0.0.0
bind_port: 8003
api_config: {}
obfuscation_nonce: nXYZ=
defaults:
hunt_expiry_hours: 168
notebook_cell_timeout_min: 10
notebook_number_of_local_workers: 5
certificate_validity_days: 3650
org_id: root
org_name: <root>

And this is minion node –

version:
name: velociraptor
version: 0.74.5
commit: "049040963"
build_time: "2025-07-03T16:12:10Z"
compiler: go1.23.2
system: linux
architecture: amd64
Client:
server_urls:
- https://<MASTER-IP>:7445/
- https://<MINION-IP>:7445/
ca_certificate: |
-----BEGIN CERTIFICATE-----
XYZ
-----END CERTIFICATE-----
nonce: 7ifqBGZaToE=
writeback_darwin: /etc/velociraptor.writeback.yaml
writeback_linux: /etc/velociraptor.writeback.yaml
writeback_windows: $ProgramFiles\Velociraptor\velociraptor.writeback.yaml
level2_writeback_suffix: .bak
tempdir_windows: $ProgramFiles\Velociraptor\Tools
max_poll: 60
nanny_max_connection_delay: 600
windows_installer:
service_name: Velociraptor
install_path: $ProgramFiles\Velociraptor\Velociraptor.exe
service_description: Velociraptor service
darwin_installer:
service_name: com.velocidex.velociraptor
install_path: /usr/local/sbin/velociraptor
version:
name: velociraptor
version: 0.74.5
commit: "049040963"
build_time: "2025-07-03T16:12:10Z"
compiler: go1.23.2
system: linux
architecture: amd64
server_version:
version: 0.74.5
commit: "049040963"
build_time: "2025-07-03T16:12:10Z"
use_self_signed_ssl: true
max_upload_size: 5242880
local_buffer:
memory_size: 52428800
disk_size: 1073741824
filename_linux: /var/tmp/Velociraptor_Buffer.bin
filename_windows: $TEMP/Velociraptor_Buffer.bin
filename_darwin: /var/tmp/Velociraptor_Buffer.bin

API:
bind_address: 192.168.10.206
bind_port: 8001
bind_scheme: tcp
pinned_gw_name: GRPC_GW

GUI:
bind_address: 0.0.0.0
bind_port: 8889
gw_certificate: |
-----BEGIN CERTIFICATE-----
XYZ
-----END CERTIFICATE-----
gw_private_key: |
-----BEGIN RSA PRIVATE KEY-----
XYZ
-----END RSA PRIVATE KEY-----
public_url: https://192.168.10.206:8889/
links:
- text: Documentation
url: https://docs.velociraptor.app/
icon_url: data:image/svg+xml;base64,<LINK>
type: sidebar
new_tab: true
initial_users:
- name: XYZ
password_hash: XYZ
password_salt: XYZ
authenticator:
type: Basic
CA:
private_key: |
-----BEGIN RSA PRIVATE KEY-----
XYZ
-----END RSA PRIVATE KEY-----
Frontend:
hostname: MASTER-IP
bind_address: 0.0.0.0
bind_port: 7445
certificate: |
-----BEGIN CERTIFICATE-----
XYZ
-----END CERTIFICATE-----
private_key: |
-----BEGIN RSA PRIVATE KEY-----
XYZ
-----END RSA PRIVATE KEY-----
default_client_monitoring_artifacts:
- Generic.Client.Stats
GRPC_pool_max_size: 100
GRPC_pool_max_wait: 60
resources:
connections_per_second: 100
notifications_per_second: 30
max_upload_size: 10485760
expected_clients: 30000
ExtraFrontends:
- hostname: MINION-IP
bind_address: 0.0.0.0
bind_port: 7445
resources:
connections_per_second: 100
notifications_per_second: 30
max_upload_size: 10485760
expected_clients: 30000
Datastore:
location: /opt/velociraptor
filestore_directory: /opt/velociraptor
minion_implementation: RemoteFileDataStore
master_implementation: MemcacheFileDataStore
Logging:
output_directory: /opt/velociraptor/logs
separate_logs_per_component: true
debug:
disabled: true
info:
rotation_time: 604800
max_age: 31536000
error:
rotation_time: 604800
max_age: 31536000
Monitoring:
bind_address: 0.0.0.0
bind_port: 8003
api_config: {}
obfuscation_nonce: XYZ
defaults:
hunt_expiry_hours: 168
notebook_cell_timeout_min: 10
notebook_number_of_local_workers: 5
certificate_validity_days: 3650
org_id: root
org_name: <root>

Please help me with this.

Mike Cohen

unread,

Jan 13, 2026, 2:33:42 AM (3 days ago) Jan 13

to Doraemon Nobi, velociraptor-discuss

This looks like a connectivity problem between the minion and master on the RPC connection - did you say there was a proxy between them?

You should manually verify that API connections are possible between the minion node and the master node

https://docs.velociraptor.app/docs/server_automation/server_api/

Make sure there are no proxies or other things between the minion and master that can introduce latency.

Also make sure that both the master and minion are able to mount the distributed filestore (e.g. NFS) with low latency. You can view the datastore latencies in the metrics

https://docs.velociraptor.app/docs/troubleshooting/debugging/internal/metrics/

Use the curl method on the minion to understand the remote data store latency characteristics

Thanks

Mike

Mike Cohen
Digital Paleontologist,
Velocidex Enterprises

E mi...@velocidex.com

--
You received this message because you are subscribed to the Google Groups "velociraptor-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to velociraptor-dis...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/velociraptor-discuss/1391f227-c530-4962-8e40-622a9caf4635n%40googlegroups.com.

Doraemon Nobi

unread,

Jan 13, 2026, 5:56:43 AM (2 days ago) Jan 13

to velociraptor-discuss

I ran this command from minion node - velociraptor --api_config api.config.yaml query "SELECT * FROM info()" --format jsonl

And got this -

{"Hostname":"xyz-prod-velociraptor-master","Uptime":5879599,"BootTime":1762414783,"OS":"linux","Platform":"ubuntu","PlatformFamily":"debian","PlatformVersion":"22.04","KernelVersion":"5.15.0-161-generic","VirtualizationSystem":"kvm","VirtualizationRole":"guest","CompilerVersion":"go1.23.2","HostID":"42f700e8-b904-4435-9d22-23b62d53114b","Exe":"/usr/local/bin/velociraptor","CWD":"/","IsAdmin":false,"ClientStart":"2026-01-12T09:35:10.515698411Z","LocalTZ":"UTC","LocalTZOffset":0,"Fqdn":"3c-prod-velociraptor-master","Architecture":"amd64"}

Which means there is not network-related issue between master and minion. Moreover they are part of the same subnet, so there are no network restrictions between them.

Also, there is not proxy "between" them , it's just that both of them are behind an HA Proxy, which I think is not relevant to whatever issue we are facing.

Now regarding the NFS, I am not using any NFS server so I am simply saving all the data on master node.

The thing is that I haven't had issue with this in the beginning , it's only after a certain number of endpoints were connected and their hunts were ran and then we have had this notebook sync issue.

Following are the latencies that I have grabbed from the /metrics URL -

datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.01"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.060000000000000005"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.11000000000000001"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.16000000000000003"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.21000000000000002"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.26"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.31"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.36"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.41"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="0.45999999999999996"} 1313
datastore_latency_bucket{action="delete",datastore="FileBaseDataStore",tag="ClientTask",le="+Inf"} 1313
datastore_latency_sum{action="delete",datastore="FileBaseDataStore",tag="ClientTask"} 0.16035568800000022
datastore_latency_count{action="delete",datastore="FileBaseDataStore",tag="ClientTask"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.01"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.060000000000000005"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.11000000000000001"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.16000000000000003"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.21000000000000002"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.26"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.31"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.36"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.41"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="0.45999999999999996"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheDatastore",tag="ClientTask",le="+Inf"} 1313
datastore_latency_sum{action="delete",datastore="MemcacheDatastore",tag="ClientTask"} 0.022825494999999963
datastore_latency_count{action="delete",datastore="MemcacheDatastore",tag="ClientTask"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.01"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.060000000000000005"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.11000000000000001"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.16000000000000003"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.21000000000000002"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.26"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.31"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.36"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.41"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.45999999999999996"} 1313
datastore_latency_bucket{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask",le="+Inf"} 1313
datastore_latency_sum{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask"} 0.020864968999999987
datastore_latency_count{action="delete",datastore="MemcacheFileDataStore",tag="ClientTask"} 1313
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.01"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.060000000000000005"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.11000000000000001"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.16000000000000003"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.21000000000000002"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.26"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.31"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.36"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.41"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="0.45999999999999996"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientIndex",le="+Inf"} 20
datastore_latency_sum{action="list",datastore="FileBaseDataStore",tag="ClientIndex"} 0.0001662
datastore_latency_count{action="list",datastore="FileBaseDataStore",tag="ClientIndex"} 20
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.01"} 53143
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.060000000000000005"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.11000000000000001"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.16000000000000003"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.21000000000000002"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.26"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.31"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.36"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.41"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="0.45999999999999996"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue",le="+Inf"} 53147
datastore_latency_sum{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue"} 3.2960839829999924
datastore_latency_count{action="list",datastore="FileBaseDataStore",tag="ClientTaskQueue"} 53147
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.01"} 6133
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.060000000000000005"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.11000000000000001"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.16000000000000003"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.21000000000000002"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.26"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.31"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.36"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.41"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="0.45999999999999996"} 6203
datastore_latency_bucket{action="list",datastore="FileBaseDataStore",tag="Generic",le="+Inf"} 6203
datastore_latency_sum{action="list",datastore="FileBaseDataStore",tag="Generic"} 6.67785567899999
datastore_latency_count{action="list",datastore="FileBaseDataStore",tag="Generic"} 6203
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.01"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.060000000000000005"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.11000000000000001"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.16000000000000003"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.21000000000000002"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.26"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.31"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.36"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.41"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="0.45999999999999996"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientIndex",le="+Inf"} 20
datastore_latency_sum{action="list",datastore="MemcacheDatastore",tag="ClientIndex"} 2.5551999999999995e-05
datastore_latency_count{action="list",datastore="MemcacheDatastore",tag="ClientIndex"} 20
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.01"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.060000000000000005"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.11000000000000001"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.16000000000000003"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.21000000000000002"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.26"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.31"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.36"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.41"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="0.45999999999999996"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue",le="+Inf"} 150827
datastore_latency_sum{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue"} 1.6671871789999921
datastore_latency_count{action="list",datastore="MemcacheDatastore",tag="ClientTaskQueue"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.01"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.060000000000000005"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.11000000000000001"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.16000000000000003"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.21000000000000002"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.26"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.31"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.36"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.41"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="0.45999999999999996"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheDatastore",tag="Generic",le="+Inf"} 50139
datastore_latency_sum{action="list",datastore="MemcacheDatastore",tag="Generic"} 1.8221474680000045
datastore_latency_count{action="list",datastore="MemcacheDatastore",tag="Generic"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.01"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.060000000000000005"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.11000000000000001"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.16000000000000003"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.21000000000000002"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.26"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.31"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.36"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.41"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="0.45999999999999996"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex",le="+Inf"} 20
datastore_latency_sum{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex"} 0.00034905200000000003
datastore_latency_count{action="list",datastore="MemcacheFileDataStore",tag="ClientIndex"} 20
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.01"} 150822
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.060000000000000005"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.11000000000000001"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.16000000000000003"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.21000000000000002"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.26"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.31"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.36"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.41"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="0.45999999999999996"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue",le="+Inf"} 150827
datastore_latency_sum{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue"} 6.467310642000137
datastore_latency_count{action="list",datastore="MemcacheFileDataStore",tag="ClientTaskQueue"} 150827
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.01"} 49962
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.060000000000000005"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.11000000000000001"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.16000000000000003"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.21000000000000002"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.26"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.31"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.36"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.41"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="0.45999999999999996"} 50139
datastore_latency_bucket{action="list",datastore="MemcacheFileDataStore",tag="Generic",le="+Inf"} 50139
datastore_latency_sum{action="list",datastore="MemcacheFileDataStore",tag="Generic"} 10.411416155999838
datastore_latency_count{action="list",datastore="MemcacheFileDataStore",tag="Generic"} 50139
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.01"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.060000000000000005"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.11000000000000001"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.16000000000000003"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.21000000000000002"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.26"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.31"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.36"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.41"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="0.45999999999999996"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Artifact",le="+Inf"} 13
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="Artifact"} 0.0005427320000000001
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="Artifact"} 13
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.01"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.060000000000000005"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.11000000000000001"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.16000000000000003"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.21000000000000002"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.26"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.31"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.36"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.41"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="0.45999999999999996"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientKey",le="+Inf"} 7518
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="ClientKey"} 0.18511562199999967
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="ClientKey"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.01"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.060000000000000005"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.11000000000000001"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.16000000000000003"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.21000000000000002"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.26"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.31"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.36"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.41"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="0.45999999999999996"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ClientTask",le="+Inf"} 4573
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="ClientTask"} 0.254305013
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="ClientTask"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.01"} 59628
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.060000000000000005"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.11000000000000001"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.16000000000000003"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.21000000000000002"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.26"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.31"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.36"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.41"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="0.45999999999999996"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowContext",le="+Inf"} 59629
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="FlowContext"} 15.95742531500005
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="FlowContext"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.01"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.060000000000000005"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.11000000000000001"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.16000000000000003"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.21000000000000002"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.26"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.31"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.36"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.41"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="0.45999999999999996"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="FlowStats",le="+Inf"} 59629
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="FlowStats"} 1.1554953480000008
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="FlowStats"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.01"} 1.057188e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.060000000000000005"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.11000000000000001"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.16000000000000003"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.21000000000000002"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.26"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.31"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.36"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.41"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="0.45999999999999996"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Generic",le="+Inf"} 1.057191e+06
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="Generic"} 46.553227326002414
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="Generic"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.01"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.060000000000000005"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.11000000000000001"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.16000000000000003"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.21000000000000002"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.26"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.31"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.36"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.41"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="0.45999999999999996"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="Notebook",le="+Inf"} 577
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="Notebook"} 0.17504733599999986
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="Notebook"} 577
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.01"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.060000000000000005"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.11000000000000001"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.16000000000000003"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.21000000000000002"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.26"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.31"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.36"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.41"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="0.45999999999999996"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="NotebookCell",le="+Inf"} 64
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="NotebookCell"} 0.0031858759999999994
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="NotebookCell"} 64
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.01"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.060000000000000005"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.11000000000000001"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.16000000000000003"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.21000000000000002"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.26"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.31"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.36"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.41"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="0.45999999999999996"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="ServerState",le="+Inf"} 1
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="ServerState"} 8.196e-06
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="ServerState"} 1
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.01"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.060000000000000005"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.11000000000000001"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.16000000000000003"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.21000000000000002"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.26"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.31"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.36"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.41"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="0.45999999999999996"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="User",le="+Inf"} 11661
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="User"} 0.10865613699999972
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="User"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.01"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.060000000000000005"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.11000000000000001"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.16000000000000003"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.21000000000000002"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.26"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.31"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.36"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.41"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="0.45999999999999996"} 2
datastore_latency_bucket{action="read",datastore="MemcacheDatastore",tag="UserACLS",le="+Inf"} 2
datastore_latency_sum{action="read",datastore="MemcacheDatastore",tag="UserACLS"} 2.8379e-05
datastore_latency_count{action="read",datastore="MemcacheDatastore",tag="UserACLS"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.01"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.060000000000000005"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.11000000000000001"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.16000000000000003"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.21000000000000002"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.26"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.31"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.36"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.41"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="0.45999999999999996"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Artifact",le="+Inf"} 13
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="Artifact"} 0.001528344
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="Artifact"} 13
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.01"} 7516
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.060000000000000005"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.11000000000000001"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.16000000000000003"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.21000000000000002"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.26"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.31"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.36"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.41"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.45999999999999996"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientKey",le="+Inf"} 7518
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="ClientKey"} 0.8094987239999998
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="ClientKey"} 7518
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.01"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.060000000000000005"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.11000000000000001"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.16000000000000003"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.21000000000000002"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.26"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.31"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.36"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.41"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.45999999999999996"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ClientTask",le="+Inf"} 4573
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="ClientTask"} 0.3285401769999994
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="ClientTask"} 4573
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.01"} 59627
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.060000000000000005"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.11000000000000001"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.16000000000000003"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.21000000000000002"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.26"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.31"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.36"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.41"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.45999999999999996"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowContext",le="+Inf"} 59629
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="FlowContext"} 19.849096095999755
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="FlowContext"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.01"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.060000000000000005"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.11000000000000001"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.16000000000000003"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.21000000000000002"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.26"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.31"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.36"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.41"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.45999999999999996"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="FlowStats",le="+Inf"} 59629
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="FlowStats"} 1.7766074180000138
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="FlowStats"} 59629
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.01"} 1.057185e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.060000000000000005"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.11000000000000001"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.16000000000000003"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.21000000000000002"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.26"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.31"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.36"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.41"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="0.45999999999999996"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Generic",le="+Inf"} 1.057191e+06
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="Generic"} 65.59483503500232
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="Generic"} 1.057191e+06
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.01"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.060000000000000005"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.11000000000000001"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.16000000000000003"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.21000000000000002"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.26"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.31"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.36"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.41"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="0.45999999999999996"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="Notebook",le="+Inf"} 577
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="Notebook"} 0.19736944599999975
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="Notebook"} 577
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.01"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.060000000000000005"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.11000000000000001"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.16000000000000003"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.21000000000000002"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.26"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.31"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.36"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.41"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.45999999999999996"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell",le="+Inf"} 64
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell"} 0.008914308999999999
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="NotebookCell"} 64
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.01"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.060000000000000005"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.11000000000000001"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.16000000000000003"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.21000000000000002"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.26"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.31"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.36"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.41"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="0.45999999999999996"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="ServerState",le="+Inf"} 1
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="ServerState"} 0.000116856
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="ServerState"} 1
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.01"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.060000000000000005"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.11000000000000001"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.16000000000000003"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.21000000000000002"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.26"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.31"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.36"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.41"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="0.45999999999999996"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="User",le="+Inf"} 11661
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="User"} 0.36250028999999956
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="User"} 11661
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.01"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.060000000000000005"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.11000000000000001"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.16000000000000003"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.21000000000000002"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.26"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.31"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.36"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.41"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.45999999999999996"} 2
datastore_latency_bucket{action="read",datastore="MemcacheFileDataStore",tag="UserACLS",le="+Inf"} 2
datastore_latency_sum{action="read",datastore="MemcacheFileDataStore",tag="UserACLS"} 5.3847e-05
datastore_latency_count{action="read",datastore="MemcacheFileDataStore",tag="UserACLS"} 2
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.01"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.060000000000000005"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.11000000000000001"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.16000000000000003"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.21000000000000002"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.26"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.31"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.36"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.41"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="0.45999999999999996"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientKey",le="+Inf"} 3
datastore_latency_sum{action="write",datastore="MemcacheDatastore",tag="ClientKey"} 8.4268e-05
datastore_latency_count{action="write",datastore="MemcacheDatastore",tag="ClientKey"} 3
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.01"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.060000000000000005"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.11000000000000001"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.16000000000000003"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.21000000000000002"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.26"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.31"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.36"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.41"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="0.45999999999999996"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="ClientTask",le="+Inf"} 1125
datastore_latency_sum{action="write",datastore="MemcacheDatastore",tag="ClientTask"} 0.043596194000000026
datastore_latency_count{action="write",datastore="MemcacheDatastore",tag="ClientTask"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.01"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.060000000000000005"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.11000000000000001"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.16000000000000003"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.21000000000000002"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.26"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.31"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.36"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.41"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="0.45999999999999996"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowContext",le="+Inf"} 251
datastore_latency_sum{action="write",datastore="MemcacheDatastore",tag="FlowContext"} 0.04304750399999999
datastore_latency_count{action="write",datastore="MemcacheDatastore",tag="FlowContext"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.01"} 580184
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.060000000000000005"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.11000000000000001"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.16000000000000003"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.21000000000000002"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.26"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.31"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.36"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.41"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="0.45999999999999996"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowStats",le="+Inf"} 580185
datastore_latency_sum{action="write",datastore="MemcacheDatastore",tag="FlowStats"} 36.20711201399992
datastore_latency_count{action="write",datastore="MemcacheDatastore",tag="FlowStats"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.01"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.060000000000000005"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.11000000000000001"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.16000000000000003"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.21000000000000002"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.26"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.31"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.36"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.41"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="0.45999999999999996"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="FlowTask",le="+Inf"} 251
datastore_latency_sum{action="write",datastore="MemcacheDatastore",tag="FlowTask"} 0.013077857000000007
datastore_latency_count{action="write",datastore="MemcacheDatastore",tag="FlowTask"} 251
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.01"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.060000000000000005"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.11000000000000001"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.16000000000000003"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.21000000000000002"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.26"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.31"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.36"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.41"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="0.45999999999999996"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheDatastore",tag="Generic",le="+Inf"} 1825
datastore_latency_sum{action="write",datastore="MemcacheDatastore",tag="Generic"} 0.057368619999999974
datastore_latency_count{action="write",datastore="MemcacheDatastore",tag="Generic"} 1825
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.01"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.060000000000000005"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.11000000000000001"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.16000000000000003"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.21000000000000002"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.26"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.31"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.36"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.41"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="0.45999999999999996"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Artifact",le="+Inf"} 12
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="Artifact"} 0.005140738
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="Artifact"} 12
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.01"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.060000000000000005"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.11000000000000001"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.16000000000000003"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.21000000000000002"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.26"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.31"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.36"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.41"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="0.45999999999999996"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientKey",le="+Inf"} 3
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="ClientKey"} 0.00023196800000000004
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="ClientKey"} 3
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.01"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.060000000000000005"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.11000000000000001"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.16000000000000003"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.21000000000000002"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.26"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.31"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.36"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.41"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="0.45999999999999996"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="ClientTask",le="+Inf"} 1125
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="ClientTask"} 0.10589238200000006
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="ClientTask"} 1125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.01"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.060000000000000005"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.11000000000000001"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.16000000000000003"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.21000000000000002"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.26"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.31"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.36"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.41"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="0.45999999999999996"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowContext",le="+Inf"} 251
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="FlowContext"} 0.11914709600000002
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="FlowContext"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.01"} 580182
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.060000000000000005"} 580184
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.11000000000000001"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.16000000000000003"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.21000000000000002"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.26"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.31"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.36"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.41"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="0.45999999999999996"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowStats",le="+Inf"} 580185
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="FlowStats"} 93.53817022300238
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="FlowStats"} 580185
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.01"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.060000000000000005"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.11000000000000001"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.16000000000000003"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.21000000000000002"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.26"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.31"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.36"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.41"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="0.45999999999999996"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="FlowTask",le="+Inf"} 251
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="FlowTask"} 0.02888785999999999
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="FlowTask"} 251
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.01"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.060000000000000005"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.11000000000000001"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.16000000000000003"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.21000000000000002"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.26"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.31"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.36"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.41"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="0.45999999999999996"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Generic",le="+Inf"} 1929
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="Generic"} 0.13490927800000005
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="Generic"} 1929
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.01"} 125
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.060000000000000005"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.11000000000000001"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.16000000000000003"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.21000000000000002"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.26"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.31"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.36"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.41"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="0.45999999999999996"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="Notebook",le="+Inf"} 126
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="Notebook"} 0.087124138
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="Notebook"} 126
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.01"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.060000000000000005"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.11000000000000001"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.16000000000000003"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.21000000000000002"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.26"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.31"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.36"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.41"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="0.45999999999999996"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell",le="+Inf"} 100
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell"} 0.024703265999999998
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="NotebookCell"} 100
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.01"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.060000000000000005"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.11000000000000001"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.16000000000000003"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.21000000000000002"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.26"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.31"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.36"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.41"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="0.45999999999999996"} 1
datastore_latency_bucket{action="write",datastore="MemcacheFileDataStore",tag="UserACLS",le="+Inf"} 1
datastore_latency_sum{action="write",datastore="MemcacheFileDataStore",tag="UserACLS"} 0.000125402
datastore_latency_count{action="write",datastore="MemcacheFileDataStore",tag="UserACLS"} 1
# HELP filestore_latency Latency to access filestore.
# TYPE filestore_latency histogram
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.01"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.060000000000000005"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.11000000000000001"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.16000000000000003"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.21000000000000002"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.26"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.31"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.36"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.41"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="0.45999999999999996"} 775
filestore_latency_bucket{action="list",datastore="DirectoryFileStore",tag="Generic",le="+Inf"} 775
filestore_latency_sum{action="list",datastore="DirectoryFileStore",tag="Generic"} 0.11201793100000006
filestore_latency_count{action="list",datastore="DirectoryFileStore",tag="Generic"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.01"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.060000000000000005"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.11000000000000001"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.16000000000000003"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.21000000000000002"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.26"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.31"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.36"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.41"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="0.45999999999999996"} 775
filestore_latency_bucket{action="list",datastore="MemcacheFileStore",tag="Generic",le="+Inf"} 775
filestore_latency_sum{action="list",datastore="MemcacheFileStore",tag="Generic"} 0.11507303700000003
filestore_latency_count{action="list",datastore="MemcacheFileStore",tag="Generic"} 775
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.01"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.060000000000000005"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.11000000000000001"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.16000000000000003"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.21000000000000002"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.26"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.31"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.36"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.41"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="0.45999999999999996"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex",le="+Inf"} 1
filestore_latency_sum{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex"} 3.9451e-05
filestore_latency_count{action="open_read",datastore="DirectoryFileStore",tag="FlowIndex"} 1
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.01"} 38612
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.060000000000000005"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.11000000000000001"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.16000000000000003"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.21000000000000002"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.26"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.31"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.36"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.41"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="0.45999999999999996"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="Generic",le="+Inf"} 38619
filestore_latency_sum{action="open_read",datastore="DirectoryFileStore",tag="Generic"} 2.079734817000006
filestore_latency_count{action="open_read",datastore="DirectoryFileStore",tag="Generic"} 38619
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.01"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.060000000000000005"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.11000000000000001"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.16000000000000003"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.21000000000000002"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.26"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.31"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.36"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.41"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.45999999999999996"} 144
filestore_latency_bucket{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery",le="+Inf"} 144
filestore_latency_sum{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery"} 0.009650474000000003
filestore_latency_count{action="open_read",datastore="DirectoryFileStore",tag="NotebookQuery"} 144
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.01"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.060000000000000005"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.11000000000000001"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.16000000000000003"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.21000000000000002"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.26"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.31"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.36"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.41"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="0.45999999999999996"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex",le="+Inf"} 251
filestore_latency_sum{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex"} 0.020291978000000013
filestore_latency_count{action="open_write",datastore="DirectoryFileStore",tag="FlowIndex"} 251
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.01"} 1.744096e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.060000000000000005"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.11000000000000001"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.16000000000000003"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.21000000000000002"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.26"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.31"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.36"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.41"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="0.45999999999999996"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="Generic",le="+Inf"} 1.744102e+06
filestore_latency_sum{action="open_write",datastore="DirectoryFileStore",tag="Generic"} 176.13212277800707
filestore_latency_count{action="open_write",datastore="DirectoryFileStore",tag="Generic"} 1.744102e+06
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.01"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.060000000000000005"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.11000000000000001"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.16000000000000003"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.21000000000000002"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.26"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.31"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.36"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.41"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="0.45999999999999996"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs",le="+Inf"} 60
filestore_latency_sum{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs"} 0.009044720000000001
filestore_latency_count{action="open_write",datastore="DirectoryFileStore",tag="NotebookCellLogs"} 60
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.01"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.060000000000000005"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.11000000000000001"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.16000000000000003"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.21000000000000002"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.26"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.31"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.36"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.41"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="0.45999999999999996"} 102
filestore_latency_bucket{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery",le="+Inf"} 102
filestore_latency_sum{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery"} 0.010689184999999995
filestore_latency_count{action="open_write",datastore="DirectoryFileStore",tag="NotebookQuery"} 102
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.01"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.060000000000000005"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.11000000000000001"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.16000000000000003"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.21000000000000002"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.26"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.31"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.36"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.41"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.45999999999999996"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex",le="+Inf"} 1
filestore_latency_sum{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex"} 5.9186e-05
filestore_latency_count{action="read_open",datastore="MemcacheFileStore",tag="FlowIndex"} 1
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.01"} 38612
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.060000000000000005"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.11000000000000001"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.16000000000000003"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.21000000000000002"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.26"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.31"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.36"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.41"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="0.45999999999999996"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="Generic",le="+Inf"} 38619
filestore_latency_sum{action="read_open",datastore="MemcacheFileStore",tag="Generic"} 2.5704493670000144
filestore_latency_count{action="read_open",datastore="MemcacheFileStore",tag="Generic"} 38619
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.01"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.060000000000000005"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.11000000000000001"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.16000000000000003"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.21000000000000002"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.26"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.31"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.36"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.41"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.45999999999999996"} 144
filestore_latency_bucket{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="+Inf"} 144
filestore_latency_sum{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery"} 0.012606318
filestore_latency_count{action="read_open",datastore="MemcacheFileStore",tag="NotebookQuery"} 144
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.01"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.060000000000000005"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.11000000000000001"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.16000000000000003"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.21000000000000002"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.26"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.31"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.36"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.41"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="0.45999999999999996"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="FlowIndex",le="+Inf"} 254
filestore_latency_sum{action="stat",datastore="DirectoryFileStore",tag="FlowIndex"} 0.011216940999999992
filestore_latency_count{action="stat",datastore="DirectoryFileStore",tag="FlowIndex"} 254
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.01"} 884585
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.060000000000000005"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.11000000000000001"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.16000000000000003"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.21000000000000002"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.26"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.31"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.36"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.41"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="0.45999999999999996"} 884594
filestore_latency_bucket{action="stat",datastore="DirectoryFileStore",tag="Generic",le="+Inf"} 884594
filestore_latency_sum{action="stat",datastore="DirectoryFileStore",tag="Generic"} 43.1433945569987
filestore_latency_count{action="stat",datastore="DirectoryFileStore",tag="Generic"} 884594
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.01"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.060000000000000005"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.11000000000000001"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.16000000000000003"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.21000000000000002"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.26"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.31"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.36"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.41"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="0.45999999999999996"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="FlowIndex",le="+Inf"} 133
filestore_latency_sum{action="stat",datastore="MemcacheFileStore",tag="FlowIndex"} 0.008537503
filestore_latency_count{action="stat",datastore="MemcacheFileStore",tag="FlowIndex"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.01"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.060000000000000005"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.11000000000000001"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.16000000000000003"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.21000000000000002"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.26"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.31"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.36"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.41"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="0.45999999999999996"} 133
filestore_latency_bucket{action="stat",datastore="MemcacheFileStore",tag="Generic",le="+Inf"} 133
filestore_latency_sum{action="stat",datastore="MemcacheFileStore",tag="Generic"} 0.0043300310000000015
filestore_latency_count{action="stat",datastore="MemcacheFileStore",tag="Generic"} 133
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.01"} 1.74447e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.060000000000000005"} 1.744513e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.11000000000000001"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.16000000000000003"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.21000000000000002"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.26"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.31"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.36"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.41"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="0.45999999999999996"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="DirectoryFileWriter",tag="Generic",le="+Inf"} 1.744515e+06
filestore_latency_sum{action="write",datastore="DirectoryFileWriter",tag="Generic"} 86.83831747499788
filestore_latency_count{action="write",datastore="DirectoryFileWriter",tag="Generic"} 1.744515e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.01"} 1.813634e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.060000000000000005"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.11000000000000001"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.16000000000000003"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.21000000000000002"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.26"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.31"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.36"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.41"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="0.45999999999999996"} 1.813637e+06
filestore_latency_bucket{action="write",datastore="MemcacheFileWriter",tag="Generic",le="+Inf"} 1.813637e+06
filestore_latency_sum{action="write",datastore="MemcacheFileWriter",tag="Generic"} 5.798260176999801
filestore_latency_count{action="write",datastore="MemcacheFileWriter",tag="Generic"} 1.813637e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.01"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.060000000000000005"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.11000000000000001"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.16000000000000003"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.21000000000000002"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.26"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.31"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.36"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.41"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="0.45999999999999996"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex",le="+Inf"} 251
filestore_latency_sum{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex"} 0.002410330999999999
filestore_latency_count{action="write_open",datastore="MemcacheFileStore",tag="FlowIndex"} 251
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.01"} 1.843401e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.060000000000000005"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.11000000000000001"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.16000000000000003"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.21000000000000002"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.26"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.31"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.36"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.41"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="0.45999999999999996"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="Generic",le="+Inf"} 1.843403e+06
filestore_latency_sum{action="write_open",datastore="MemcacheFileStore",tag="Generic"} 26.743545666998067
filestore_latency_count{action="write_open",datastore="MemcacheFileStore",tag="Generic"} 1.843403e+06
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.01"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.060000000000000005"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.11000000000000001"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.16000000000000003"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.21000000000000002"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.26"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.31"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.36"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.41"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="0.45999999999999996"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs",le="+Inf"} 63
filestore_latency_sum{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs"} 0.0013505020000000004
filestore_latency_count{action="write_open",datastore="MemcacheFileStore",tag="NotebookCellLogs"} 63
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.01"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.060000000000000005"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.11000000000000001"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.16000000000000003"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.21000000000000002"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.26"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.31"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.36"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.41"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="0.45999999999999996"} 102
filestore_latency_bucket{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery",le="+Inf"} 102
filestore_latency_sum{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery"} 0.0016155809999999998
filestore_latency_count{action="write_open",datastore="MemcacheFileStore",tag="NotebookQuery"} 102
# HELP frontend_concurrency_wait_latency Latency for clients waiting to get a concurrency slot (excludes actual serving time).

The latency metrics do look normal. Is there anything else we can point out this issue to ? I have pasted my config files from my master and minion nodes as well. Is there anything over there that can be pointed out ?

Doraemon Nobi

unread,

Jan 13, 2026, 6:18:34 AM (2 days ago) Jan 13

to velociraptor-discuss

These are the minion latency metrics - # HELP replication_master_send_latency Latency for the master to send replication messages to the minion.
# TYPE replication_master_send_latency histogram
replication_master_send_latency_bucket{status="",le="0.1"} 27428
replication_master_send_latency_bucket{status="",le="1.1"} 27428
replication_master_send_latency_bucket{status="",le="2.1"} 27428
replication_master_send_latency_bucket{status="",le="3.1"} 27428
replication_master_send_latency_bucket{status="",le="4.1"} 27428
replication_master_send_latency_bucket{status="",le="5.1"} 27428
replication_master_send_latency_bucket{status="",le="6.1"} 27428
replication_master_send_latency_bucket{status="",le="7.1"} 27428
replication_master_send_latency_bucket{status="",le="8.1"} 27428
replication_master_send_latency_bucket{status="",le="9.1"} 27428
replication_master_send_latency_bucket{status="",le="+Inf"} 27428
replication_master_send_latency_sum{status=""} 1.0255963940000001
replication_master_send_latency_count{status=""} 27428
# HELP replication_minion_latency Latency to send replication messages from minion to the master.
# TYPE replication_minion_latency histogram
replication_minion_latency_bucket{le="0.1"} 0
replication_minion_latency_bucket{le="1.1"} 0
replication_minion_latency_bucket{le="2.1"} 0
replication_minion_latency_bucket{le="3.1"} 0
replication_minion_latency_bucket{le="4.1"} 0
replication_minion_latency_bucket{le="5.1"} 0
replication_minion_latency_bucket{le="6.1"} 0
replication_minion_latency_bucket{le="7.1"} 0
replication_minion_latency_bucket{le="8.1"} 0
replication_minion_latency_bucket{le="9.1"} 0
replication_minion_latency_bucket{le="+Inf"} 0
replication_minion_latency_sum 0
replication_minion_latency_count 0

Nothing abnormal , I believe.

Doraemon Nobi

unread,

Jan 14, 2026, 6:35:09 AM (yesterday) Jan 14

to velociraptor-discuss

Hi, is there anything else that this problem could be pointed out to ?

Reply all

Reply to author

Forward

0 new messages