distortion when cutting scene is caused when the encoder isn't able to 'keep up' with the changes.
you'll have to use a higher quality encoding setting to get rid of that
specifically, you want to increase the bitrate for a given size
(and of course - there are a gazillion wierdnesses about exactly when VLC might have an issue with a specific file)
I dont' have any other ideas I'm afraid