An SDP solver doesn't just work in the space which you think of (your variables x) but in a space which also involve dual variables y. You might be able to make a good guess x*, but you don't have any way of supplying a suitable friend y*, which will work well for the solver
Sounds like you want to use a penalty, e.g.,
objective = whatever + (x-goodpoint)'*(x-goodpoint)*penaltyparameter
or
objective = whatever + norm(x-goodpoint)*penaltyparameter
or
...