Sum of the abs value differences can be linearized as following:
min sum |x_i - f_i|
will become
min sum a_i+b_i
subject to
x_i - f_i - a_i + b_i = 0
I understand your concern for finding a way to make it without this linearization procedure... However, you shall not have an abs operator in the obj. function. Even though you are introducing two more variables into your model and making it more complicated, you are getting the benefit of using linear programming rather than losing time with non-linear.