No, a new version will be normally speaking installed in another
directory, and you should not overwrite the old directory with files
from new Sage.
You can just remove the old directory.
If you modified your environment variables to point to a version of
Sage, or installed Sage scripts in (say) in /usr/local/bin
you might want to update these.
HTH,
Dmitrii