I don't think this is related or limited to Automate.
When I delete files using automate from a folder, the audio player application doesn't notice that they have been removed and chokes on a file it can't find. When doing the same using astro file manager it doesn't have a problem. Is there a database or manifest that needs to be refreshed? - General android issue I think.