The install-plugins.sh script allows the user to set the reference directory via environment variable. The plugin manager tool should also support setting the reference directory from the environment variable.
Fixed in PR: https://github.com/jenkinsci/plugin-installation-manager-tool/pull/29
PR was merged in.