An easy approximation is to check whether the polygon's bounds
intersects with the map bounds.
http://code.google.com/apis/maps/documentation/javascript/reference.html#LatLngBounds
(scroll down to intersects)
That won't be perfect, but it should provide more data than is
necessary rather than leaving something out which should be retrieved.