Hi,
it depends if you want to "unbias" for the presence of the walls.
If you try to do it, you will notice that this will result in large statistical errors on the walls because you actually spent less time there. Also notice that the same is true if you run a plain MD with walls: to remove a posteriori the bias of the walls, you will actually increase the weights of the frames on the walls, that are few (because the system was discouraged to go there), making errors very large.
Typically if you used walls it is because you didn't want the system to go somewhere, so it does not make sense to compute the free energy *exactly there*.
There is a special case where you can reconstruct what happens past the walls without the system explicitly going there, e.g. when you limit the conformational space for a ligand so that it does not explore the full box. In this case, the result would be dependent on the ligand concentration (in the experiment) and thus, doing the math right, you can obtain the correct free-energy at a fixed bulk concentration of the ligand.
Yet another case is when you add walls to make sure something nasty wouldn't happen, but it would not have happened anyway. The walls will never be activated and their unbiasing will lead to no change.
Hope this clarifies things more than confusing them... overall the answer is problem dependent I think.
Giovanni