The hand tool only moves your current view around the stage. It will in no way affect the animation.
To move the camera, use the edit tool. Select "Camera1" (or whatever camera you are moving) in the first box in the tool options, and then you can edit the position of the camera. Hold <ctrl> to move in and out along the Z-axis. You can also rotate or make other edits to the camera by changing the mode of the edit tool within the second tool option box.
Editing the camera can also be achieved via the Function Editor in the Xsheet room, or by the Schematic view using pegs. If you want to do panning, you'll likely want to work with one of these options.
Here's a tutorial on moving objects along a path in the Schematic view:
https://www.youtube.com/watch?v=zaB2CyvP4LgYou can change the output of the peg to be the camera instead of the column to pan the camera.