node_exporter not able to discover expected filesystem devices

25 views
Skip to first unread message

Sohaib Omar

unread,
May 13, 2020, 8:09:08 AM5/13/20
to Prometheus Users
Hi all, node_exporter is not able to return filesystem_bytes except devices that are mounted on "/" below are the filesystem devices on my azure instance.

Filesystem             Type     1K-blocks    Used Available Use% Mounted on
udev                   devtmpfs   8167128       0   8167128   0% /dev
tmpfs                  tmpfs      1637096    3204   1633892   1% /run
/dev/sdb1              ext4      30309264 7512552  22780328  25% /
tmpfs                  tmpfs      8185464      12   8185452   1% /dev/shm
tmpfs                  tmpfs         5120       0      5120   0% /run/lock
tmpfs                  tmpfs      8185464       0   8185464   0% /sys/fs/cgroup
/dev/mapper/logs-vol   ext4      10253588   85088   9627932   1% /var/log
/dev/mapper/docker-vol ext4      30830500 3699564  25541792  13% /var/lib/docker
/dev/sdb15             vfat        106858    3668    103190   4% /boot/efi
/dev/sdc1              ext4      32895696   49180  31152468   1% /mnt
tmpfs                  tmpfs      1637092       0   1637092   0% /run/user/1000


I am running node_exporter as a daemonset in Kubernetes, with the below config, I am only able to get filesystem info of only one ext4 fs-type /(dev/sdb1). Whereas I was expecting to see the filesystem stats of all ext4 fs types. 
node_exporter: v0.18.1
daemonset-spec.yaml
spec:
containers:
- args:
- --path.procfs=/host/proc
- --path.sysfs=/host/sys
- --collector.filesystem.ignored-mount-points=^/(dev|sys)($|/)
- --collector.filesystem.ignored-fs-types=^(autofs|binfmt_misc|cgroup|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|mqueue|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|sysfs|tracefs)$
name: node-exporter
volumeMounts:
- mountPath: /host/proc
name: proc
readOnly: false
- mountPath: /host/sys
name: sys
readOnly: false
- mountPath: /host/root
mountPropagation: HostToContainer
name: root
readOnly: true

volumes:
- hostPath:
path: /proc
name: proc
- hostPath:
path: /sys
name: sys
- hostPath:
path: /
name: root

 What am I doing wrong here?

I also get the bellow error by node_exporter
time="2020-05-13T11:11:32Z" level=debug msg="Error on statfs() system call for \"/mnt\": no such file or directory" source="filesystem_linux.go:90"
time="2020-05-13T11:15:32Z" level=debug msg="Error on statfs() system call for \"/var/log\": no such file or directory" source="filesystem_linux.go:90"
time="2020-05-13T11:15:32Z" level=debug msg="Error on statfs() system call for \"/var/lib/docker\": no such file or directory" source="filesystem_linux.go:90"


Thanks
Reply all
Reply to author
Forward
0 new messages