Dear Yunfei,
The linear system you solve depends on the weak form of the problem you are solving, which is established from the strong form of the PDE.
If you want to reconstruct the force from the displacement field, I think you would need to formulate the adjoint PDE problem to your displacement PDE. I think since the linear elasticity equation is a Poisson-ish equation, the equation would be self-adjoint and the adjoint system could be formed straightforwardly from the forward problem.
I hope that helps
Bruno