FYI...
Apparently this is how it's designed? It seems kind of strange that the changes only last until you start debugging, since launching a script always resets the python interpreter first. It seems that it reads sys.path from the current interactive session, and that's the only place it applies your changes.
I needed to change the PYTHONPATH in the environment variables and restart PyScripter. That did the trick.