This is exactly how it works, yes.
If you import numpy as np in one tab it is now in memory in the single python interpreter instance of Maya. Any tab will reflect this.
If you are testing a module and make changes to it, then you can use the reload() command.
import myModule
# make changes
reload(myModule)
There isn't really a clean way to just flat out delete a module, as it can still have remaining references in other areas. You could just say: del myModule, which will kill that global reference. But anything else that imported or used it will still have access to it in memory.