There isn't (that I know of) a built-in browser for Eclipse. So I just open a browser of choice, Explorer, Chrome, Firefox, and point it to the directory (if just doing html), or crank up a node http-server if doing middleware like ColdFusion, that requires a server.
My workflow then becomes edit, save, alt-tab to browser window, refresh.