Generally speaking, the problem cannot be solved with CVXOPT. If F_1 and F_2 are mappings from R_n to R, then your constraint is equivalent to
-sqrt(epsilon) < F_1(x) - F_2(x) < sqrt(epsilon)
and hence F_1 and F_2 must be linear operators in order for the feasible set to be convex.