The default binarizer consists of a number of steps, one of which performs this operation. It's implemented by the class StandardPreprocessing in C++. It has a number of thresholds and parameters you can set. You can see the settable parameters by typing
ocropus params StandardPreprocessing
You can either change the rmbig_... parameters or just remove the RmBig component from the preprocessing stack altogether.
Tom