The page loads in the browser so if you want to reduce latency, improve the server's performance, the network connection, or the computer on which the page is rendered. To the best of my knowledge, it's not something that Selenium controls or effects.
As for losing connection to the server, since HTTP is stateless, you lose connection to the server after every item is sent to the browser. If you lose connection while an item is being sent, get a more stable connection. It's not something that Selenium controls.
Walter