You can paste this excel-vba code (attached) into a module in your spreadsheet and use the user-defined functions for these measures. In all cases (I think) the functions require you to choose a range of observed values and a range of modeled values.
I don't have RMSE, but it's the numerator in the RSR function, so you could copy the code and modify it pretty easily to make your own RMSE function.
I'm sure these functions could be improved -- I only learn enough VBA bit by bit, as needed.
-- Jim