Issues with Minio on BeeGFS

[Emir Imamagic]

Hello,

we're trying to set up test Minio instance on BeeGFS 7.1.5 with 4
directories. Minio version used is RELEASE.2021-11-24T23-19-33Z.
Server starts successfully:
minio server /mnt/beegfs/data{01..04}

However, once we try uploading data server fails with:
API: SYSTEM()
Time: 19:05:45 CET 12/07/2021
DeploymentID: 0ad797b0-2a95-41e1-8952-0b0ca0f3b9f8
Error: file not found (cmd.StorageErr)
5: cmd/xl-storage.go:1953:cmd.(*xlStorage).RenameData.func1()
4: cmd/xl-storage.go:2201:cmd.(*xlStorage).RenameData()
3:
cmd/xl-storage-disk-id-check.go:391:cmd.(*xlStorageDiskIDCheck).RenameData()
2: cmd/erasure-object.go:552:cmd.renameData.func1()
1:
internal/sync/errgroup/errgroup.go:123:errgroup.(*Group).Go.func1()

BeeGFS client log provides following errors:
(0) Dec07 19:05:45 *minio(30141) [Remoting (write file)] >> Error
storage targetID: 1; Msg: Invalid argument; FileHandle:
5FCD1D38#125-61AFA244-1
(0) Dec07 19:05:45 *minio(30141) [Remoting (write file)] >> Error
storage targetID: 1; Msg: Invalid argument; FileHandle:
5FCD1D39#127-61AFA244-1
(0) Dec07 19:05:45 *minio(30141) [Remoting (write file)] >> Error
storage targetID: 1; Msg: Invalid argument; FileHandle:
5FCD1D3A#128-61AFA244-1
(0) Dec07 19:05:45 *minio(30141) [Remoting (write file)] >> Error
storage targetID: 1; Msg: Invalid argument; FileHandle:
5FCD1D3B#129-61AFA244-1

BeeGFS storage log provides:
(2) Dec07 19:05:45 Worker27 [WriteChunkFileMsg (write incremental)] >>
Write error occurred. FileHandleID: 5FCD1D38#125-61AFA244-1.Target: 1.
File: 125-61AFA244-1. SysErr: Invalid argument
(3) Dec07 19:05:45 Worker27 [WriteChunkFileMsg (write incremental)] >>
Additional info: FD: 570 OpenFlags: 16385 received: 110.
(2) Dec07 19:05:45 Worker21 [WriteChunkFileMsg (write incremental)] >>
Write error occurred. FileHandleID: 5FCD1D39#127-61AFA244-1.Target: 1.
File: 127-61AFA244-1. SysErr: Invalid argument
(3) Dec07 19:05:45 Worker21 [WriteChunkFileMsg (write incremental)] >>
Additional info: FD: 570 OpenFlags: 16385 received: 110.
(2) Dec07 19:05:45 Worker36 [WriteChunkFileMsg (write incremental)] >>
Write error occurred. FileHandleID: 5FCD1D3A#128-61AFA244-1.Target: 1.
File: 128-61AFA244-1. SysErr: Invalid argument
(3) Dec07 19:05:45 Worker36 [WriteChunkFileMsg (write incremental)] >>
Additional info: FD: 570 OpenFlags: 16385 received: 110.
(2) Dec07 19:05:45 Worker11 [WriteChunkFileMsg (write incremental)] >>
Write error occurred. FileHandleID: 5FCD1D3B#129-61AFA244-1.Target: 1.
File: 129-61AFA244-1. SysErr: Invalid argument
(3) Dec07 19:05:45 Worker11 [WriteChunkFileMsg (write incremental)] >>
Additional info: FD: 570 OpenFlags: 16385 received: 110.


We suspect the issue is that Minio doesn't really support shared storage
in combination with erasure coding configuration. Still we would like to
understand what is happening on BeeGFS side.


Thanks in advance
Emir Imamagic