Data corruption found in datastore

[Saulius B]

Hello guys,

I have numerous entries in the log like this one:

org.opendedup.sdfs.filestore.ConsistancyCheck$HashFetcher.run(ConsistancyCheck.java:105) 105 - Data Corruption found in datastore

There are two SDFS volumes configured on the system, one is fine, the other won't mount after unsuccessful machine shutdown / hard reboot.

There's another problem I have discovered: apparently, datastores should be created on separate ports:

sdfs:/etc/sdfs/sdfspool0-volume-cfg.xml:6442  268499456   84207232  184292224  32% /media/sdfspool0

sdfs:/etc/sdfs/sdfspool1-volume-cfg.xml:6443  524352000   94781440  429570560  19% /media/sdfspool1

Idea taken from here: https://groups.google.com/forum/#!topic/dedupfilesystem-sdfs-user-discuss/YLdHiuxhb1I

In my configuration both volumes are on the same port. This is why I am unable to perform any tasks on the affected volume as it seems that the "good" one is using the sdfscli port now. I have changed the configuration for the good volume and will try to restart SDFS (after graceful unmount).

Any ideas how to deal with data corruption? This is backup archive volume, so would be really great to restore the data... 

Thank you in advance!

Saulius

[Chip Burke]

Have you tried setting "graceful shutdown=false" in the XML files and remounting? It will force a scan and repair what it can.

[Saulius B]

Thank you, will try. It tried to do repair by itself, but it never succeeds (left it running for a week on 2TB storage). 

[Saulius B]

Chip,

perhaps you meant the setting in <volume> context which reads closed-gracefully="false" - this one was already like that and perhaps this is the reason DSE consistency check is triggered. But it never succeeds. 

Any ideas on how to get at least some of the data back?

Thanks

Saulius

[Sam Silverberg]

Can you share the sdfs logs in /var/logs/sdfs ?

--
You received this message because you are subscribed to the Google Groups "dedupfilesystem-sdfs-user-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dedupfilesystem-sdfs-u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Saulius B]

Sam,

thank you for your intentions to help :)

this is sdfs.log:

$

2016-07-15 18:12:04,858 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-15 18:14:45,090 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught when processing request: Connection refused

2016-07-15 18:14:45,092 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-15 18:14:45,095 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-15 18:14:45,095 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-15 18:14:45,098 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-15 18:14:45,098 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-15 18:16:01,617 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-15 18:16:01,619 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-15 18:16:01,622 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-15 18:16:01,622 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-15 18:16:01,625 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-15 18:16:01,625 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:11:19,196 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:11:19,256 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:11:19,260 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:11:19,261 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:11:19,263 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:11:19,263 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:45:26,903 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:45:26,905 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:45:26,909 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:45:26,909 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:45:26,912 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:45:26,912 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:45:30,574 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:45:30,576 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:45:30,579 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:45:30,580 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 10:45:30,582 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 10:45:30,583 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 11:16:56,357 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 11:16:56,379 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 11:16:56,382 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 11:16:56,382 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 11:16:56,384 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 11:16:56,384 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 16:21:45,955 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 16:21:46,079 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 16:21:46,081 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 16:21:46,082 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

2016-07-26 16:21:46,085 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439) 439 - I/O exception (java.net.ConnectException) caught whe$

2016-07-26 16:21:46,085 [org.apache.commons.httpclient.HttpMethodDirector] [main]  org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445) 445 - Retrying request

this is sdfs_vol-volume-cfg.xml.log - this relates to the failed volume, not pasting the other one, which works fine:

(numerous errors like that)

2016-07-26 10:46:11,123 [sdfs] [Thread-36]  org.opendedup.sdfs.filestore.ConsistancyCheck$HashFetcher.run(ConsistancyCheck.java:105) 105 - Data Corruption found in datastore

java.io.IOException: java.io.IOException: org.opendedup.collections.MapClosedException

        at org.opendedup.sdfs.filestore.BatchFileChunkStore.getNextChunck(BatchFileChunkStore.java:296)

        at org.opendedup.sdfs.filestore.ConsistancyCheck$HashFetcher.run(ConsistancyCheck.java:97)

        at java.lang.Thread.run(Thread.java:745)

Caused by: java.io.IOException: org.opendedup.collections.MapClosedException

        at org.opendedup.sdfs.filestore.HashBlobArchive.getHashesString(HashBlobArchive.java:1002)

        at org.opendedup.sdfs.filestore.HashBlobArchive.getStrings(HashBlobArchive.java:137)

        at org.opendedup.sdfs.filestore.BatchFileChunkStore.getStringResult(BatchFileChunkStore.java:654)

        at org.opendedup.sdfs.filestore.cloud.MultiDownload.addStringResult(MultiDownload.java:106)

        at org.opendedup.sdfs.filestore.cloud.MultiDownload.access$1(MultiDownload.java:105)

        at org.opendedup.sdfs.filestore.cloud.MultiDownload$KeyGetter.run(MultiDownload.java:119)

        ... 1 more

Caused by: org.opendedup.collections.MapClosedException

        at org.opendedup.collections.SimpleByteArrayLongMap.next(SimpleByteArrayLongMap.java:74)

        at org.opendedup.sdfs.filestore.HashBlobArchive.getHashesString(HashBlobArchive.java:993)

        ... 6 more

2016-07-26 10:46:11,123 [sdfs] [Thread-26]  org.opendedup.sdfs.filestore.ConsistancyCheck$HashFetcher.run(ConsistancyCheck.java:105) 105 - Data Corruption found in datastore

java.io.IOException: java.io.IOException: org.opendedup.collections.MapClosedException

        at org.opendedup.sdfs.filestore.BatchFileChunkStore.getNextChunck(BatchFileChunkStore.java:296)

        at org.opendedup.sdfs.filestore.ConsistancyCheck$HashFetcher.run(ConsistancyCheck.java:97)

        at java.lang.Thread.run(Thread.java:745)

Caused by: java.io.IOException: org.opendedup.collections.MapClosedException

        at org.opendedup.sdfs.filestore.HashBlobArchive.getHashesString(HashBlobArchive.java:1002)

        at org.opendedup.sdfs.filestore.HashBlobArchive.getStrings(HashBlobArchive.java:137)

        at org.opendedup.sdfs.filestore.BatchFileChunkStore.getStringResult(BatchFileChunkStore.java:654)

        at org.opendedup.sdfs.filestore.cloud.MultiDownload.addStringResult(MultiDownload.java:106)

        at org.opendedup.sdfs.filestore.cloud.MultiDownload.access$1(MultiDownload.java:105)

        at org.opendedup.sdfs.filestore.cloud.MultiDownload$KeyGetter.run(MultiDownload.java:119)

        ... 1 more

Caused by: org.opendedup.collections.MapClosedException

        at org.opendedup.collections.SimpleByteArrayLongMap.next(SimpleByteArrayLongMap.java:74)

        at org.opendedup.sdfs.filestore.HashBlobArchive.getHashesString(HashBlobArchive.java:993)

        ... 6 more

further down the same log - this is something new, after one more restart, don't know what's different this time, but I think I have not seen this in the logs previously:

2016-07-26 11:19:09,289 [sdfs] [main]  org.opendedup.sdfs.Config.parseSDFSConfigFile(Config.java:261) 261 - ############ Running SDFS Version 3.1.11

2016-07-26 11:19:09,310 [sdfs] [main]  org.opendedup.sdfs.Config.parseSDFSConfigFile(Config.java:268) 268 - Parsing volume subsystem-config version 3.0.4

2016-07-26 11:19:09,311 [sdfs] [main]  org.opendedup.sdfs.Config.parseSDFSConfigFile(Config.java:273) 273 - parsing folder locations

2016-07-26 11:19:09,311 [sdfs] [main]  org.opendedup.sdfs.Config.parseSDFSConfigFile(Config.java:301) 301 - Setting hash engine to VARIABLE_MURMUR3

2016-07-26 11:19:09,316 [sdfs] [main]  org.opendedup.hashing.HashFunctionPool.<clinit>(HashFunctionPool.java:35) 35 - Set hashtype to VARIABLE_MURMUR3

2016-07-26 11:19:09,319 [sdfs] [main]  org.opendedup.sdfs.io.Volume.<init>(Volume.java:186) 186 - Mounting volume /array/files

2016-07-26 11:19:09,336 [sdfs] [main]  org.opendedup.sdfs.io.Volume.<init>(Volume.java:249) 249 - Volume write threshold is 0.95

2016-07-26 11:19:09,336 [sdfs] [main]  org.opendedup.sdfs.io.Volume.<init>(Volume.java:281) 281 - Setting volume size to 2968681447424

2016-07-26 11:19:09,337 [sdfs] [main]  org.opendedup.sdfs.io.Volume.<init>(Volume.java:283) 283 - Setting maximum capacity to 2820247375052

2016-07-26 11:19:09,361 [sdfs] [main]  org.opendedup.sdfs.Config.parseSDFSConfigFile(Config.java:416) 416 - ######### Will allocate 2967822401536 in chunkstore ##############

2016-07-26 11:19:09,361 [sdfs] [main]  org.opendedup.sdfs.Config.parseSDFSConfigFile(Config.java:476) 476 - ################## Encryption is NOT enabled ##################

2016-07-26 11:19:09,466 [eventlog] [main]  org.opendedup.logging.SDFSEventLogger.log(SDFSEventLogger.java:82) 82 -

2016-07-26 11:19:09,502 [sdfs] [main]  org.opendedup.sdfs.servers.SDFSService.start(SDFSService.java:54) 54 - HashFunction Min Block Size=4095 Max Block Size=32768

2016-07-26 11:19:09,502 [sdfs] [main]  org.opendedup.sdfs.servers.HCServiceProxy.init(HCServiceProxy.java:159) 159 - Starting local chunkstore

2016-07-26 11:19:09,550 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:186) 186 - ############################ Initialied HashBlobArchive ##############################

2016-07-26 11:19:09,550 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:187) 187 - Version : 1.0

2016-07-26 11:19:09,550 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:188) 188 - HashBlobArchive IO Threads : 16

2016-07-26 11:19:09,551 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:189) 189 - HashBlobArchive Max Upload Size : 31457280

2016-07-26 11:19:10,531 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:200) 200 - HashBlobArchive Max Map Size : 10241

2016-07-26 11:19:10,531 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:201) 201 - HashBlobArchive Maximum Local Cache Size : 10737418240

2016-07-26 11:19:10,531 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:202) 202 - HashBlobArchive Max Thread Sleep Time : 15000

2016-07-26 11:19:10,531 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:203) 203 - HashBlobArchive Spool Directory : /array/chunkstore/chunks

2016-07-26 11:19:10,533 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:275) 275 - ############################ HashBlobArchive Checking for Archives not uploaded ##############################

2016-07-26 11:19:10,699 [sdfs] [main]  org.opendedup.sdfs.filestore.HashBlobArchive.init(HashBlobArchive.java:319) 319 - ################################# Done Uploading Archives #################

2016-07-26 11:19:11,137 [sdfs] [main]  org.opendedup.sdfs.filestore.HashStore.connectDB(HashStore.java:166) 166 - Loading hashdb class org.opendedup.collections.ProgressiveFileBasedCSMap

2016-07-26 11:19:11,138 [sdfs] [main]  org.opendedup.sdfs.filestore.HashStore.connectDB(HashStore.java:168) 168 - Maximum Number of Entries is 362291008

2016-07-26 11:19:11,140 [eventlog] [main]  org.opendedup.logging.SDFSEventLogger.log(SDFSEventLogger.java:82) 82 -

2016-07-26 11:19:11,141 [sdfs] [main]  org.opendedup.collections.ProgressiveFileBasedCSMap.setUp(ProgressiveFileBasedCSMap.java:419) 419 - Folder = /array/chunkstore/hdb/hashstore-sdfs

2016-07-26 11:19:11,141 [sdfs] [main]  org.opendedup.collections.ProgressiveFileBasedCSMap.setUp(ProgressiveFileBasedCSMap.java:420) 420 - Loading freebits bitset

2016-07-26 11:19:11,143 [sdfs] [main]  org.opendedup.collections.ProgressiveFileBasedCSMap.setMaxSize(ProgressiveFileBasedCSMap.java:401) 401 - table setup max=89478385 maxsz=362291008 _tbs=11321594 calculated hashtblesz=11321594 hashTb$

2016-07-26 11:19:11,175 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:307) 307 - Resetting size of hashtable to [5660797] instead of [11321659]

2016-07-26 11:19:11,175 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=5660797 maxSz=4245597

2016-07-26 11:19:11,175 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 135859128

2016-07-26 11:19:11,176 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:347) 347 - bpos does not exist

2016-07-26 11:19:11,176 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:370) 370 - vmp does not exist

2016-07-26 11:19:11,176 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:387) 387 - vrp does not exist

2016-07-26 11:19:11,176 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:404) 404 - bf does not exist

2016-07-26 11:19:14,281 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.recreateMap(ProgressiveFileByteArrayLongMap.java:261) 261 - Recovered Hashmap /array/chunkstore/hdb/hashstore-sdfs-A5FF9323-6196-6986-BEF2-$

2016-07-26 11:19:14,282 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.7499998675098224 full=false

2016-07-26 11:19:14,283 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 11:19:14,283 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 11:19:14,283 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:347) 347 - bpos does not exist

2016-07-26 11:19:14,283 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:370) 370 - vmp does not exist

2016-07-26 11:19:14,283 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:387) 387 - vrp does not exist

2016-07-26 11:19:14,283 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:404) 404 - bf does not exist

2016-07-26 11:19:18,415 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.recreateMap(ProgressiveFileByteArrayLongMap.java:261) 261 - Recovered Hashmap /array/chunkstore/hdb/hashstore-sdfs-AB5B30AC-1221-EB43-92FC-$

2016-07-26 11:19:18,415 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=8.832627797745895E-8 full=false

2016-07-26 11:19:18,417 [sdfs] [Thread-6]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.run(ProgressiveFileByteArrayLongMap.java:1360) 1360 - caching /array/chunkstore/hdb/hashstore-sdfs-AB5B30AC-1221-EB43-92FC-2137D6B9C4DD

2016-07-26 11:19:18,417 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 11:19:18,417 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 11:19:18,417 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:347) 347 - bpos does not exist

2016-07-26 11:19:18,417 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:370) 370 - vmp does not exist

2016-07-26 11:19:18,417 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:387) 387 - vrp does not exist

2016-07-26 11:19:18,417 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:404) 404 - bf does not exist

2016-07-26 11:19:18,661 [sdfs] [Thread-6]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.run(ProgressiveFileByteArrayLongMap.java:1387) 1387 - done caching /array/chunkstore/hdb/hashstore-sdfs-AB5B30AC-1221-EB43-92FC-2137D6B$

2016-07-26 11:19:22,494 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.recreateMap(ProgressiveFileByteArrayLongMap.java:261) 261 - Recovered Hashmap /array/chunkstore/hdb/hashstore-sdfs-47554264-36FB-3AF3-6748-$

2016-07-26 11:19:22,495 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=8.832627797745895E-8 full=false

2016-07-26 11:19:22,520 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:307) 307 - Resetting size of hashtable to [5660797] instead of [11321659]

2016-07-26 11:19:22,520 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=5660797 maxSz=4245597

2016-07-26 11:19:22,520 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 135859128

2016-07-26 11:19:22,520 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:347) 347 - bpos does not exist

2016-07-26 11:19:22,520 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:370) 370 - vmp does not exist

2016-07-26 11:19:22,520 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:387) 387 - vrp does not exist

2016-07-26 11:19:22,521 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:404) 404 - bf does not exist

2016-07-26 11:19:25,045 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.recreateMap(ProgressiveFileByteArrayLongMap.java:261) 261 - Recovered Hashmap /array/chunkstore/hdb/hashstore-sdfs-03626874-848F-597F-0DD0-$

2016-07-26 11:19:25,045 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.3450045991756991 full=false

2016-07-26 11:19:25,046 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 11:19:25,046 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 11:19:25,046 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:347) 347 - bpos does not exist

2016-07-26 11:19:25,046 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:370) 370 - vmp does not exist

2016-07-26 11:19:25,046 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:387) 387 - vrp does not exist

2016-07-26 11:19:25,046 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:404) 404 - bf does not exist

2016-07-26 11:19:29,152 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.recreateMap(ProgressiveFileByteArrayLongMap.java:261) 261 - Recovered Hashmap /array/chunkstore/hdb/hashstore-sdfs-5AF87461-3D8B-917A-C61C-$

2016-07-26 11:19:29,152 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=8.832627797745895E-8 full=false

2016-07-26 11:19:29,153 [sdfs] [main]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

<...> - same as above

2016-07-26 11:23:52,399 [sdfs] [main]  org.opendedup.collections.ProgressiveFileBasedCSMap.setUp(ProgressiveFileBasedCSMap.java:462) 462 - Recreating BloomFilters...

2016-07-26 11:24:51,050 [eventlog] [main]  org.opendedup.logging.SDFSEventLogger.log(SDFSEventLogger.java:82) 82 -

2016-07-26 11:24:51,100 [sdfs] [main]  org.opendedup.collections.ProgressiveFileBasedCSMap.setUp(ProgressiveFileBasedCSMap.java:523) 523 - Loaded entries 127711358

2016-07-26 11:24:51,101 [sdfs] [main]  org.opendedup.collections.ProgressiveFileBasedCSMap.setUp(ProgressiveFileBasedCSMap.java:524) 524 - Loading BloomFilters 127711358

2016-07-26 11:24:51,101 [sdfs] [main]  org.opendedup.sdfs.filestore.HashStore.<init>(HashStore.java:85) 85 - Cache Size = 262144

2016-07-26 11:24:51,101 [sdfs] [main]  org.opendedup.sdfs.filestore.HashStore.<init>(HashStore.java:86) 86 - Total Entries 127711358

2016-07-26 11:24:51,101 [sdfs] [main]  org.opendedup.sdfs.filestore.HashStore.<init>(HashStore.java:87) 87 - Added sdfs

2016-07-26 11:24:51,101 [sdfs] [main]  org.opendedup.sdfs.servers.HashChunkService.runConsistancyCheck(HashChunkService.java:222) 222 - DSE did not close gracefully, running consistancy check

2016-07-26 11:25:39,753 [sdfs] [main]  org.opendedup.sdfs.filestore.ConsistancyCheck.runCheck(ConsistancyCheck.java:23) 23 - Running Consistancy Check on DSE, this may take a while

2016-07-26 11:25:39,801 [eventlog] [main]  org.opendedup.logging.SDFSEventLogger.log(SDFSEventLogger.java:82) 82 -

2016-07-26 12:24:01,184 [sdfs] [Thread-36]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,287 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,287 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,287 [sdfs] [Thread-33]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,287 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,287 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,184 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,412 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:24:01,533 [sdfs] [Thread-36]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-33]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:01,533 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:24:02,108 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,108 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,108 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,108 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,108 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,108 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,108 [sdfs] [Thread-33]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:24:02,159 [sdfs] [Thread-36]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:08,611 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,611 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,719 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,719 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,726 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,726 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,777 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:08,784 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:08,920 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,920 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,921 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,920 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,921 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,920 [sdfs] [Thread-36]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:33:08,925 [sdfs] [Thread-36]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,925 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:33:08,977 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:08,981 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:08,983 [sdfs] [Thread-36]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:08,993 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:33:09,008 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,473 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,473 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,473 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,473 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,473 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,473 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,473 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,473 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,473 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,473 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,473 [sdfs] [Thread-33]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:312) 312 - sz=11321659 maxSz=8491244

2016-07-26 12:42:18,495 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,494 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,495 [sdfs] [Thread-33]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:317) 317 - set table to size 271719816

2016-07-26 12:42:18,567 [sdfs] [Thread-35]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,571 [sdfs] [Thread-39]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,574 [sdfs] [Thread-33]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,574 [sdfs] [Thread-32]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,589 [sdfs] [Thread-34]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,608 [sdfs] [Thread-37]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

2016-07-26 12:42:18,612 [sdfs] [Thread-38]  org.opendedup.collections.ProgressiveFileByteArrayLongMap.setUp(ProgressiveFileByteArrayLongMap.java:434) 434 - Percentage full=0.0 full=false

<EOF>

[Sam Silverberg]

Saulius,

It's hard to tell what the issue is based on the logs you shared. Does it say that the dse scan is still running at this point?

If you would like, you can mount the volume unclean by changing safe-close from false to true and see if that helps. What is the back end for this volume is it aws or local disk?

[Saulius B]

Sam,

thank you for your suggestion. I thought to change this flag to "true", but was afraid t olose any data. DSE check never finishes, no matter if left for the whole week. It is a RAID array of local disks.

Will try to set the flag to "true". Do you know if I am risking to lose the data?

Thanks again.

Saulius

[Sam Silverberg]

You might loose data that was in flight at the time that you closed the volume. But other than that it should be ok.

[Saulius B]

Thank you. Ok, will give it a shot and post results.

On Thursday, August 4, 2016 at 6:55:32 PM UTC+3, Sam Silverberg wrote:

You might loose data that was in flight at the time that you closed the volume. But other than that it should be ok.

On Wed, Aug 3, 2016 at 5:25 AM, Saulius B <saulius.b...@gmail.com> wrote:

Sam,

thank you for your suggestion. I thought to change this flag to "true", but was afraid t olose any data. DSE check never finishes, no matter if left for the whole week. It is a RAID array of local disks.

Will try to set the flag to "true". Do you know if I am risking to lose the data?

Thanks again.

Saulius

--
You received this message because you are subscribed to the Google Groups "dedupfilesystem-sdfs-user-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to dedupfilesystem-sdfs-user-discuss+unsubscribe@googlegroups.com.