Deleting COMMIT_EDITMSG does fix the problem, but only for the next commit. Once that commit happens, COMMIT_EDITMSG is left around again. I suspect that the COMMIT_EDITMSG buffer and/or file should be killed/deleted once the commit happens. For some reason this isn't happening for me.