You generally need to do more than #! as GWT is all javascript..
However, cleanest approach is to make your own PlaceHistoryMapper - you can then control exactly how places are turned into tokens.
You will also need to provide html snapshots though, which is a lot tougher...