Two additional steps are needed to be performed:
1) Renaming the Admin-folder within the project to the new preferred path
2) Changing the path accordingly in the web.config <location path="Admin">
It's worth noting that this introduces a minor problem if upgrading the KalikoCMS.Core NuGet-package in the future since the renaming of the Admin-folder needs to be redone.
There might be a way to solve this by doing a rewrite instead and keeping the physical path, but I haven't tested that myself (could however look into it further if it would be of interest).
The next generation of Kaliko CMS that is under development will have a brand new admin UI that will be virtually provided from code in order to make both deployment and changes like this easier and more robust.
Best regards,
Fredrik