I believe the person creating the package didn't consider that either, as there are examples of how to create Points that manually set the (unexported) fields that are impossible to do in go from anywhere but in the golang-geo package itself. IE: the tests could succeed, but no-one else can build points that way.
Neither of the package's forks resolve this either.
The simplest solution if making your own fork would be to create a New function that generates a point with given lat, long values. That way no other code is affected by renaming fields.