Hi Boris,
Sorry for the delay.
Thank you for your feedback.
The cache directory is is not supposed to be deleted or cleared. By default the caching is enabled and the cached scripts are created and kept on the PC to speed up the script loading. The approach is very similar to the Python "compiled scripts".
If for whatever reason you want to remove the cache directory you can do it by modifying the <cs-script>\Lib\clearTemp.cs script, which is run periodically and it is the routine responsible for the cleaning all truly temporary files (not the cache, but you can extend it to handle cache as well).
Though in this case why would you need Caching at all? You can disable it if you want. While I see no reason for this you are of course free to do so.