I don't fully understand your question. Which cache are you talking about deleting images from? How are you deleting them?
Basically, if you turn image-preserve-urls on, then you are not letting PageSpeed extend cache lifetimes by signing URLs. Instead, the caching behavior should be about the same coming through PageSpeed as it would be if PageSpeed was off.
If you give a more specific example (even hypothetical) with image names and specific mechanisms for deleting them from a cache, I can comment further.
-Josh