It will be really difficult to install all that stuff off-line. Once you install RVM, Ruby, you can init a simple Rails app by just packaging all the needed gems into vendor/cache directory of the Rails application to copy:
Just create a Rails app locally on your PC, then run (from insde of your Rails app created somewhere on your PC):
Then copy the locally created app to the server and run
This
use the gems in the cache in preference to the ones onrubygems.org.
But install Mysql, Apache & Co - dont think it to be possible offline.
Even when using tolls like Chief, Puppet.
May be the best solution will be to use Vagrant and then copy the VM to the server.