more sdfs corruption - urgent

[markr]

Hi Sam,

I set safe-closed to false and now all of latest ms exchange backups are corrupted.

All there is in the SDFS log is below.  Other people are commenting about the "already closed".

What am I doing wrong?

Thanks

Mark

2012-10-03 13:13:01,149 [Thread-5634] INFO sdfs  - removing [/usr/data/SDFS/files/EXCHANGE/FIRST STORAGE GROUP-Mailbox Database/.fuse_hidden000009e60000001c] and replacing with [/usr/data/SDFS/files/EXCHANGE/FIRST STORAGE GROUP-Mailbox Database/$FlushFS.Now]

2012-10-03 13:13:44,783 [Thread-5629] FATAL sdfs  - error while writing to /usr/data/SDFS/files/EXCHANGE/FIRST STORAGE GROUP-Mailbox Database/Mailbox Database.edb java.io.IOException: file already closed

java.io.IOException: file already closed

        at org.opendedup.sdfs.io.SparseDedupFile.getHash(SparseDedupFile.java:981)

        at org.opendedup.sdfs.io.SparseDedupFile.marshalWriteBuffer(SparseDedupFile.java:439)        at org.opendedup.sdfs.io.SparseDedupFile.getWriteBuffer(SparseDedupFile.java:421)

        at org.opendedup.sdfs.io.DedupFileChannel.writeFile(DedupFileChannel.java:246)        at fuse.SDFS.SDFSFileSystem.write(SDFSFileSystem.java:621)

        at fuse.Filesystem3ToFuseFSAdapter.write(Filesystem3ToFuseFSAdapter.java:337)2012-10-03 13:13:44,784 [Thread-5629] ERROR sdfs  - unable to write to file/EXCHANGE/FIRST STORAGE GROUP-Mailbox Database/Mailbox Database.edb

java.io.IOException: error while writing to /usr/data/SDFS/files/EXCHANGE/FIRST STORAGE GROUP-Mailbox Database/Mailbo

x Database.edb java.io.IOException: file already closed        at org.opendedup.sdfs.io.DedupFileChannel.writeFile(DedupFileChannel.java:309)        at fuse.SDFS.SDFSFileSystem.write(SDFSFileSystem.java:621)        at fuse.Filesystem3ToFuseFSAdapter.write(Filesystem3ToFuseFSAdapter.java:337)

2012-10-03 13:13:44,784 [Thread-2800] WARN sdfs  - /usr/data/SDFS/files/EXCHANGE/FIRST STORAGE GROUP-Mailbox Database/Mailbox Database.edb is closed but still writing

[cnu80]

Hi marks,

do you use the sdfs appliance? How do you connect to the SDFS? With iscsi or cifs? br cnu

[Sam Silverberg]

Mark,

The data should not be corrupt. With safe-close=flase the file will close based on inactivity not whether its closed by the file. I will look at this right now. In the mean time, try unmounting and remounting the volume.

[Sam Silverberg]

Mark,

I have provided a fix. It looks like this is an outlier case but a great find just the same. I have attached the jar file that fixes this issue please replace the current sdfs.jar with this one and let me know if you see the issue again.

[markr]

Thanks Sam, keep up the good work.

I'll let you know how it goes.

[markr]

Hi,

The data is written by an rsync daemon receiving data from a windows server running cygwin rsync.

The rsync area points to a directory in sdfs.

Thanks

Mark