One thing to consider while is perhaps a log message about the file being ignored and why, since it took our team quite a bit of debugging to figure out this being the root cause.
We got hit really badly by this since we ran it in parallel with msbuild where each project generated a xunit file and around half of the projects shared the timestamp with others.