Missing remote files (REMOTE_FILE_MISSING error) during peer comparison extremely slow, what to do?

[Brittany Latawiec]

So the setup we have going is running an audit we know to have about a ~1 million more files on one peer versus the other. 

Currently the audit of the found files completed in roughly a day. However, we noticed it is taking around 22 seconds per file for the remote missing files to be logged, making it nearly impossible for us to use ACE in this case. 

I have identified where this is happening in the code here:
https://gitlab.umiacs.umd.edu/adapt/ace/blob/master/ace-am/src/main/java/edu/umiacs/ace/monitor/audit/AuditThread.java#L827

But we are not sure where to go from here on determining why it is taking so long per file.

Any advice here?