This is just a suggestion, that does not help with your current dilemma, a strategy how you could prevent it in the future:
Create or expand your personal dotfile repository, within that repository create a folder my-racket-packages, within that folder create a info.rkt:
#lang info
(define collection "my-racket-packages")
(define deps
(list "lens"
"opengl"
"gregor"
"add your own packages here"))
This way you can create a personal package that lists all of the packages that you play around with explicitly.
Within the directory:
raco pkg install
to install the package.
When the dotfiles have changed, within the my-racket-packages directory:
raco pkg update --auto
I know this solution requires you to update the package manually, but if you install a package via raco pkg install <package-name>, you might as well add it to the info.rkt instead.
This way you have a single source of truth, instead of having to sync multiple different installations.
Instead of my-racket-packages you also could name it my-racket-experiments and save your experiment sessions with scripts along with the dependencies.
You never have to publish that package if you don't want to.