Hi Eric,
You should definitely get very similar results for two identical runs but they will never be exactly the same with Radiance as it utilizes several stochastic (or statistical models) where there is some randomness to the simulation. The higher the Radiance parameters the less variance you will see in the results of two identical runs.
If the differences you are seeing between your two different seem larger than just this stochastic randomness difference, there must be something else different with the simulation. Ensure the shade setting have been run the same and that the occupancy schedule is the same (this won't effect the design days but some of the other metrics). Changes in the months and times that you rget run will also have some impact on the overall result. The default of 3 months (equinox, summer and winter) works well but you would have a more accurate calculation if you select to run all 7 months and every single hour.
Hope this helps track down the differences you are seeing.
Cheers,
Zack